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Abstract  (U) 


An  ongoing  activity  undertaken  by  the  Situation  Analysis  Support  Systems  (SASS) 
Group  in  the  Decision  Support  Systems  (DSS)  Section  at  Defence  Research  & 
Development  Canada  (DRDC)  -  Valcartier  is  the  investigation  of  advanced  concepts  of 
data  fusion  and  sensor  management  processes,  and  their  adaptation  and  integration. 
These  concepts  could  apply  to  the  current  Halifax  Class  frigates  Above  Water  Warfare 
(AWW)  sensor  suite,  as  well  as  its  possible  future  upgrades,  in  order  to  improve  its 
performance  against  predicted  future  threats.  As  part  of  this  exploration,  a  comparative 
study  of  the  commonly  used  track-level  fusion  techniques/algorithms  is  reported  here. 
In  developing  data  fusion  systems  for  surveillance  and  tracking  purposes,  the  selection 
of  such  techniques  and/or  algorithms  is  a  fundamental  conceptual  issue.  For  any  given 
sensor  suite  configuration,  there  can  be  many  different  ways  to  combine  data  from  the 
sensors  into  global  tracks,  and  various  trade-offs  are  generally  required  for  the  selection 
of  the  appropriate  data  fusion  architecture,  since  each  approach  has  its  benefits  and 
disadvantages.  The  considered  methods  are  compared  through  the  target  tracking 
problem  that  presents  both  of  the  independent  and  correlated  source  fusion  problems. 


Resume  (U) 


Une  activite  de  recherche  entreprise  par  le  Groupe  systemes  d’aide  a  l’analyse  de  la 
situation  (SAAS)  de  la  Section  systemes  d’aide  h  la  decision  (SAD),  h  Recherche  et 
Development  pour  la  Defence  Canada  (RDDC)  -  Valcartier,  concerne  l’etude  de 
concepts  avances  de  fusion  des  donndes  et  de  gestion  des  capteurs,  ainsi  que  de  leur 
gestion  et  leur  integration.  Ces  concepts  pourraient  s’appliquer  aux  detecteurs  et 
capteurs  du  systeme  de  guerre  anti-aerienne  et  de  surface  des  frdgates  de  classe  Halifax, 
ainsi  qu’a  ses  ameliorations  possibles  a  venir,  afin  d’en  accroTtre  la  performance  contre 
les  menaces  futures  anticipdes.  Le  volet  rapportd  dans  ce  document  concerne  une  dtude 
comparative  des  techniques  et  des  algorithmes  de  fusion  de  pistes  les  plus  utilises.  La 
selection  de  tels  algorithmes  et  techniques  represente  un  element  fondamental  dans  la 
conception  des  systemes  de  fusion  de  donndes  pour  la  surveillance  et  le  pistage.  Pour 
chaque  configuration  de  capteurs,  differentes  approches  peuvent  etre  utilisees  pour 
l’agregation  en  pistes  globales  de  donnees  fournies  pas  les  mesures.  Aussi,  etant  donnd 
que  chaque  approche  presente  ses  avantages  et  inconvenients,  des  compromis  sont 
sou  vent  necessaires  dans  la  selection  de  1’  architecture  la  plus  adequate.  Les  mdthodes 
retenues  sont  comparees  dans  le  contexte  du  pistage  de  cibles,  qui  presente  a  la  fois  les 
deux  situations  :  la  fusion  de  sources  correlees  et  la  fusion  de  sources  independantes. 
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Executive  summary  (U) 


The  data  fusion  architecture  is  an  important  issue  in  developing  surveillance  and 
tracking  systems,  since  the  benefits  of  the  data  fusion  process  are  different  depending 
on  the  way  the  source  data  are  combined.  The  selection  of  appropnate  data  fusion 
algorithms  and  techniques  also  depends  on  the  underlying  architecture,  which  can 
range  from  highly  centralized  to  highly  distributed.  The  architecture  classification 
depends  upon  the  level  at  which  the  sensor  data  are  fused.  One  possible  type  of 
architecture  is  based  on  maintaining  sensor-level  tracks  using  local  information  at  each 
sensor  site  and  combining  the  resulting  tracks  into  centralized  global  tracks.  This 
architecture  is  typically  referred  to  as  track-level  fusion. 

The  primary  alternative  architecture  assumes  that  all  of  the  raw  sensor  measurements 
are  sent  directly  to  the  centralized  fusion  node  to  be  combined  into  global  tracks.  This 
architecture  is  typically  referred  to  as  contact-level  fusion.  Since  in  the  latter  the 
observation  errors  of  the  sources  to  be  fused  are  statistically  independent,  the  Kalman 
filter  provides  an  optimal  method  for  fusing  information.  This  optimality  will  however 
be  no  longer  guaranteed,  if  the  errors  of  the  fused  sources  are  correlated,  as  in  the  case 
of  the  track-level  fusion.  However,  if  the  cross  covariance  matrix  is  available,  the 
independence  assumption  imposed  by  the  Kalman  filter  can  be  relaxed.  The  filter  will 
then  still  provide  an  optimal  solution,  by  exploiting  this  additional  information.  If  the 
correlation  information  is  missing,  the  Kalman  filter  cannot  theoretically  be  applied. 

In  many  situations,  to  allow  for  the  use  of  the  Kalman  filter,  the  error  independence  is 
often  assumed  and  the  correlation  is  simply  ignored  in  the  estimation  process.  We  then 
talk  about  the  ’’simple  fusion”  approach  that  makes  the  filter  over  optimistic,  that  is,  it 
underestimates  the  covariance  matrix.  This  phenomenon  is  referred  to  as  the 
inconsistency  of  the  estimation  and  may,  in  many  situations,  lead  to  divergence. 

Different  approaches  are  available  to  handle  the  inconsistency  and  they  all  result  in  an 
increase  of  the  estimated  error  covariance  matrix.  Some  methods  try  to  directly  increase 
the  estimated  covariance  matrix,  by  introducing  an  empirically  determined  parameter. 
Since  no  rigorous  method  exists  for  choosing  this  parameter,  the  stability  and  the 
reliability  of  the  fusion  process  can  be  greatly  compromised.  Some  other  methods  aim 
at  estimating  an  upper  limit  of  the  actual  covariance  to  avoid  underestimating  it.  The 
covariance  intersection  method  and  the  largest  ellipsoid  method  both  fall  within  this 
category.  They  are  both  based  upon  an  estimation  of  the  intersection  region  for  the 
covariances  that  represents,  independently  of  the  cross  covariance,  an  upper  bound  for 
the  actual  error  covariance.  Another  solution  consists  in  estimating  the  missing  cross 
covariance  matrix  to  allow  for  the  application  of  a  general  form  of  the  Kalman  filter.  An 
example  of  algorithms  for  computing  the  cross  covariance  matrix  is  given  by  the 
weighted  covariance  method.  Finally,  since  the  inconsistency  phenomenon  is  mainly 
caused  by  the  double  counting  of  the  redundant  information,  an  interesting  solution 
consists  in  removing  this  redundancy.  The  tracklet  fusion  approach  and  the  information 
filter  method  are  two  very  practical  methods  that  use  very  similar  algorithms  to  achieve 
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this  task.  These  methods  are  all  compared  in  this  document  through  the  target  tracking 
problem  that  presents  both  of  the  independent  and  correlated  source  fusion  problems. 
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Sommaire  (U) 


L’ architecture  de  fusion  des  donnees  est  cruciale  pour  la  mise  au  point  de  systemes  de 
surveillance  et  de  poursuite,  car  les  avantages  du  processus  de  fusion  des  donnees 
varient  selon  la  fagon  dont  sont  combindes  les  donnees  des  sources.  Le  choix  des 
algorithmes  et  techniques  appropries  de  fusion  des  donndes  depend  egalement  de 
l’architecture  sous-jacente,  qui  peut  etre  largement  centralist  ou  ddcentralisde.  Le  type 
d’ architecture  depend  du  type  des  donndes  qui  sont  fusionndes.  II  existe  un  type 
d’architecture  basee  sur  le  maintien  de  pistes  au  niveau  des  capteurs  utilisant 
uniquement  reformation  locale.  Par  la  suite  les  pistes  locales  sont  combinees  en  pistes 
globales  centralisees.  On  designe  ce  type  d’architecture  comme  la  fusion  au  niveau  des 
pistes. 

L’altemative  il  ce  type  d’architecture  presuppose  que  toutes  les  mesures  brutes  des 
capteurs  sont  envoyees  directement  a  un  noeud  central  de  fusion  afin  de  les  combiner  en 
pistes  globales.  On  designe  ce  type  d’architecture  comme  la  fusion  au  niveau  des 
contacts.  Les  erreurs  d’ observation  des  sources  a  fusionner  etant  statistiquement 
independantes,  le  filtre  de  Kalman  constitue  la  methode  optimale  de  fusion 
d’ information  dans  ce  type  d’architecture.  On  ne  peut  toutefois  plus  s’attendre  a  obtenir 
le  degrd  optimal,  lorsque  les  erreurs  des  sources  k  fusionner  sont  corrdldes,  comme 
c’est  le  cas  dans  la  fusion  de  pistes.  Par  contre,  la  condition  d’independance  imposee 
par  le  filtre  de  Kalman  peut  etre  relaxee  lorsque  la  matrice  d’ inter-covariance  est 
disponible.  Le  filtre  exploitant  cette  information  additionnelle,  celui-ci  constitue 
toujours  la  meilleure  solution.  Si  l’inter-covariance  n’est  pas  disponible,  le  filtre  de 
Kalman  ne  peut  etre  utilise,  du  moins  en  theorie. 

Dans  bien  des  cas,  afin  de  permettre  l’utilisation  du  filtre  de  Kalman,  on  presuppose 
generalement  que  les  erreurs  sont  independantes,  et  le  processus  d’estimation  ne  tient 
tout  simplement  pas  compte  de  la  corrdlation.  Dans  ces  cas,  la  simple  fusion  tend 
sous-estimer  la  matrice  de  covariance  de  l’erreur.  On  parle  alors  d’inconsi stance  de 
l’estimation. 

Diverses  methodes  permettent  d’eviter  cette  inconsistance.  Toutes  ces  methode 
entrainent  un  accroissement  de  l’estime  de  la  matrice  de  covariance  de  1’erreur. 
Certaines  d’entre  elles  tentent  d’accroTtre  directement  l’estime  de  la  matrice  de 
covariance  de  1’erreur  par  l’introduction  d’un  parametre  determine  de  fagon  empirique. 
Comme  il  n’existe  pas  de  methode  rigoureuse  pour  determiner  ce  parametre,  la  stabilit6 
et  la  fiabilite  du  processus  de  fusion  peuvent  s’en  trouver  gravement  compromises. 
D’autres  methodes  permettent  de  determiner  la  limite  superieure  de  la  covariance  reelle, 
ce  qui  evite  de  ne  pas  la  sous-estimer.  La  methode  de  (’intersection  des  covariances  et 
celle  du  plus  grand  ellipsoi'de  presentent  toutes  deux  cette  caracteristique.  Les  deux  se 
fondent  sur  revaluation  de  la  zone  d’intersection  des  covariances,  laquelle  represente  la 
limite  superieure  de  la  covariance  reelle.  Une  autre  solution  consiste  a  e valuer  la 
matrice  d’inter-covariance  manquante  afin  de  permettre  1’ utilisation  dans  le  filtre  de 
Kalman.  La  methode  de  la  covariance  ponderee  comporte  des  exemples  d’ algorithmes 
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permettant  de  determiner  la  matnce  d’ inter-covariance.  Enfin,  puisque  l’incoherence 
est  surtout  attribuable  au  decompte  d’information  redondante,  on  peut  simplement  la 
supprimer.  La  methode  des  tracklets  et  celle  du  filtre  d’information  constituent  deux 
fa?ons  tres  pratiques  d’utiliser  des  algorithmes  tout  a  fait  sirrulaires  pour  y  arriver.  La 
poursuite  de  cibles,  qui  presente  a  la  fois  les  caracteristiques  des  sources  independantes 
et  correlees,  permet  de  comparer  toutes  ces  methodes  entre  elles. 


Abder  Rezak  Benaskeur  and  Jean  Roy.  2002.  Etude  comparative  des  algorithmes  de  fusion  de 
donnees  pour  le  pistage  des  cibles.  TR  2001-224.  Recherche  et  Development  pour  la  Defence 
Canada  -  Valcartier. 
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1.  Introduction 


Recent  years  have  witnessed  a  rapid  development  in  the  measurement  and  detection 
technology.  Nonetheless,  no  one  of  the  available  systems  can  be  trusted  enough  to  be 
used  as  the  single  source,  since  they  all  depend  on  noisy,  incomplete  and/or  inaccurate 
input.  This  is  even  truer  for  critical  situations,  such  as  military  applications.  Therefore, 
to  achieve  better  accuracy,  data  from  several  sources  are  often  combined.  This 
aggregation/combination,  that  allows  for  an  efficient  extraction  of  the  desired 
information,  is  referred  to  as  “data  fusion”.  In  most  situations,  it  yields  better  accuracy 
than  could  be  achieved  by  single-source-based  systems.  Even  though  the  need  for  data 
fusion  is  nowadays  recognized  in  many  areas,  applications  to  which  it  has  up  to 
recently  been  applied  have  been  mostly  military  in  nature.  In  such  a  context,  data 
fusion  provides  the  decision  maker  with  an  efficient  tool  to  manage  the  information 
he/she  might  receive  from  a  variety  of  sources  and  improve  his/her  current  situation 
awareness,  by  helping  in  producing  an  “as  accurate  as  possible”  explanatory  picture  of 
the  battle  environment. 

An  ongoing  activity  undertaken  by  the  Situation  Analysis  Support  Systems  (SASS) 
Group  in  the  Decision  Support  Systems  (DSS)  Section  at  Defence  Research  & 
Development  Canada  (DRDC)  -  Valcartier  is  the  investigation  of  advanced  concepts  of 
data  fusion  and  sensor  management  processes,  and  their  adaptation  and  integration. 
These  concepts  could  apply  to  the  current  Halifax  Class  frigates  Above  Water  Warfare 
(AWW)  sensor  suite,  as  well  as  its  possible  future  upgrades,  in  order  to  improve  its 
performance  against  predicted  future  threats  [I].  As  part  of  this  exploration,  a  highly 
modular  testbed,  called  CASE_ATTI  (Concept  Analysis  and  Simulation  Environment 
for  Automatic  Target  Tracking  and  Identification)  has  been  developed  [2, 3]. 
CASE-ATTI  provides  the  algorithm-level  test  and  replacement  capability  required  to 
study  and  compare  the  applicability  and  performance  of  advanced  state-of-the-art  data 
fusion  techniques. 

A  fundamental  conceptual  issue  in  developing  a  data  fusion  system  for  surveillance  and 
tracking  purpose  is  the  selection  of  an  appropriate  architecture  [4-7].  For  any  given 
sensor  suite  configuration,  there  can  be  many  different  ways  to  combine  data  from  the 
sensors  into  global  tracks.  This  report  presents  a  comparative  study,  making  use  of 
CASE_ATTI,  of  the  main  fusion  techniques  reported  in  the  literature. 


1 .1  Fusion  architecture 

The  data  fusion  architecture  is  an  important  issue  in  developing  surveillance  and 
tracking  systems,  since  the  benefits  of  the  fusion  process  are  different  depending  on  the 
way  the  sensor  data  are  combined  [8].  The  selection  of  the  appropriate  fusion 
algorithms  and  techniques  also  depends  on  the  underlying  architecture  [8].  Hence, 
before  a  data  fusion  algorithm  can  be  implemented  within  a  combat  system,  it  must  be 
analyzed  in  terms  of  the  different  types  of  architectures  and  implementations  that  are 
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possible,  the  benefits  and  drawbacks  of  these  architectures  and,  finally,  in  terms  of  how 
all  this  relates  to  the  performance  and  mission  requirements  of  the  platform. 

Within  the  surveyed  literature,  many  different  ways  to  combine  data  from  multiple 
sources  have  been  found,  offering  as  many  architectural  options  to  the  data  fusion 
system  designer  [4-9].  The  architecture  of  such  a  system  can  range  from  highly 
centralized  (or  monolithic)  to  highly  distributed  [10].  The  classification  depends  upon 
the  level  at  which  the  sensor  data  are  fused  (i.e.,  signal,  contact  or  track  level). 

One  possible  type  of  architecture  is  based  on  maintaining  sensor-level  tracks  using 
local  sensor  information  at  each  sensor  site,  finding  (in  a  central  fusion  resource)  the 
sensor  tracks  that  potentially  represent  the  same  target  and  then  combining  these  tracks 
into  global  tracks.  This  architecture  is  typically  referred  to  as  track-level  fusion  or 
decentralized  data  fusion.  The  primary  alternative  architecture  assumes  that  all  of  the 
raw  sensor  measurements  (i.  e.,  sensor  contacts)  are  sent  directly  to  the  centralized 
fusion  node  to  be  combined  into  global  tracks.  This  architecture  is  typically  referred  to 
as  contact-level  fusion  or  centralized  data  fusion.  Although  these  two  basic  architectural 
approaches  have  predominated  most  published  work,  fusion  at  the  signal-level  is  also 
possible.  However,  a  discussion  of  this  latter  approach  is  out  of  the  scope  of  this  work. 


1.2  Source  modeling 


In  practice,  the  sources  to  be  fused  are  often  assumed  corrupted  by  noises  and  therefore 
modeled  as  random  variables,  whose  true  statistics  are  unknown.  Within  the  estimation 
theory  framework,  such  stochastic  variables  are  often  represented  in  terms  of  means,  or 
estimates,  and  covariance  matrices,  that  is,  the  uncertainties  associated  with  the 
estimation  process.  In  this  context,  the  main  idea  of  data  fusion  is  to  get  an  estimate  of 
some  unknown  variable  from  its  two  (or  more)  available  noise-corrupted,  direct  or 
indirect,  observations.  In  the  case  of  two  sources,  si  and  s 2,  the  statistical 
representation  of  the  available  data  (observations)  is  given  by  the  means  si  and  s 2 ,  the 
assumed  error  covariance  of  each  source 


Pi  ~  E 


(1) 


P2  =  E 


(2) 


and  the  assumed  cross  covariance  of  the  two  sources 

Pc  =  £7 1 


(3) 


where  the  unknown  estimation  error  terms,  si  and  £2,  are  defined  by 

51  =  Si  -  Si  (4) 

52  =  S2  -  S2  (5) 
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The  fusion  problem  can  then  be  characterized  as  finding  a  mathematical  method  to 
describe  how  the  information  about  si  and  s2  can  be  used,  in  an  efficient  and  provably 
optimal  way,  to  construct  a  new  estimate  s  (and  an  estimate  of  its  associated  measure  of 
accuracy  P)  that  minimizes  some  cost  function.  This  updated  estimate  is  often 
obtained  via  a  linear  combination  of  the  two  available  estimates  si  and  s2. 


s  =  +  W2s2  (6) 

where  the  weights  W\  and  W2  are  computed  to  minimize  some  norm  of  the  resulting 
error  covariance  matrix  P,  whose  expression  is  given  by 

P  =  WiPyW?  +  WXPCW%  +  W2(Pc)tW1t  +  W2P2W2  (7) 

1 .3  Fusion  of  independent  sources 

If  the  sources  to  be  fused  are  statistically  independent,  that  is  Pc  —  0,  the  combined 
error  covariance  matrix  (7)  reduces  to 


P  =  WiPiW'T  +  W2P2W2 


(8) 


and  an  interesting  solution  to  the  above  described  optimization  problem  is  then  given 
by  the  weights  of  the  Kalman  filter  [11] 


wi  =  A 

> 

+ 

> 

-i 

Prl  +  p2-1 

W2  =  Pi 

' 

A  +  A 

p1-l  +  p2-1 

(9) 

(10) 


Incontestably,  the  Kalman  filter  is  one  of  the  most  important  data  fusion  tools.  If  the 
sources  to  be  fused  are  actually  statistically  independent1,  this  filter  provides, 
regardless  of  the  underlying  error  distribution,  a  mathematically  rigorous  and  provably 
stable  method  for  fusing  information  in  real-time,  and  performs  in  the  Minimum  Mean 
Square  Error  sense,  better  than  any  other  linear  filter.  The  Kalman  filter  results  in  the 
following  fusion  algorithm. 


P-1  =  Pf1  +  P2_1  (11) 

P-1S  =  Pf1fli  +  ^_1S2  (12) 


It  is  proven  that  the  quality  of  the  estimate  yielded  by  the  algorithm  ( 1 1)-(  12)  improves, 
or  at  least  remains  constant,  over  the  estimation  process. 

'Two  random  variables  are  independent,  if  their  joint  probability  density  is  the  product  of  their  marginal  (indi¬ 
vidual)  probability  densities. 
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1 .4  Fusion  of  correlated  sources 

The  optimality  of  the  above-given  Kalman  filter  will  no  longer  be  guaranteed,  if  the 
fused  sources  are  correlated.  This  may  even  compromise  the  convergence  of  the 
estimation  process.  Nevertheless,  if  the  cross  covariance  matrix  (Pc),  or  at  least  an 
estimate  of  it,  is  available,  the  independence  assumption  imposed  by  the  Kalman  filter 
can  be  relaxed.  The  filter  will  then  still  provide  an  optimal  solution,  by  exploiting  this 
additional  information.  The  resulting  weights  are  given  by 

r  -i  -t 

Wi  =  (A  -  (Pc)r)  A  +  A  -  pc  -  (pc)t 

=  (A-pc)"1  +  (A-(pc)t)"1  ( Pi-pc)~ 1  (i3) 

and 

w2  =  (A  -  pc)  A  +  A  -  pc  -  (pc)t 

=  (A  -  pT1  +  (A  -  (JAT1  \p2-(pc)t)~1  d4) 

One  can  easily  show  that  the  resulting  error  covariance  matrix  is  given  by 

p  =  A  -  A  -  pc  A  -  pc  +  A  -  (pc)t  1  A  -  (pc)t  05) 

Note  that  the  introduction  of  the  cross  correlation  matrix  in  the  Kalman  filter  is 
beneficial  only  if  this  matrix  is  definite  positive.  Furthermore,  if  the  correlation 
information  is  missing,  the  Kalman  filter  cannot  theoretically  be  applied.  In  most 
situations,  to  allow  the  use  of  the  Kalman  filter,  the  independence  is  often  assumed  and 
the  correlation  is  simply  ignored  in  the  estimation  process.  This  approach,  presented  in 
Sub-section  3.1.2  and  known  as  the  simple  fusion,  makes  the  filter  “over  optimistic”, 
that  is,  it  underestimates  the  actual  error  covariance  matrix.  We  then  talk  about  the 
inconsistency  of  the  estimation,  that  may  in  many  situations  lead  to  divergence  [12]. 
This  phenomenon  is  due  to  the  double  counting  of  the  information,  since  the  fusion 
algorithm  may  be  handling  redundant  pieces  of  information,  while  treating  them  as 
independent.  Different  approaches  are  available  to  handle  the  inconsistency  problem  of 
the  simple  fusion.  These  methods  result  all  in  an  increase  of  the  estimated  error 
covariance  matrix,  compared  to  the  simple  fusion.  As  shown  below,  the  amount  of  this 
increase  and  the  way  it  is  computed  differs  from  one  method  to  another. 

1.4.1  Stabilizing  noise 

This  approach  consists  in  increasing  directly  the  estimated  covariance  matrix, 
by  introducing  an  empirically  determined  parameter,  also  called  “fudge 
factor”  [13].  Since  there  is  no  rigorous  method  for  choosing  this  parameter, 
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the  stability  and  the  reliability  of  the  data  fusion  process  can  be  greatly 
compromised.  This  method  is  only  mentioned  for  completeness  and  will  not 
be  considered  in  the  remainder. 


1.4.2  Upper  bound 

Instead  of  artificially  increasing  the  estimated  error  covariance,  some  methods 
aim  at  finding  an  estimate  for  an  upper  limit  of  the  actual  error  covariance,  to 
avoid  underestimating  it.  The  covariance  intersection  method  [14]  and  the 
recently  proposed  largest  ellipsoid  method  [15],  fall  both  within  this  category. 
They  are  both  based  upon  an  estimation  of  the  intersection  region  that 
represents,  independently  of  the  cross  covariance,  an  upper  bound  for  the 
actual  error  covariance.  These  methods  result  often  in  a  loose  of  performance, 
due  to  the  overestimation  of  the  actual  covariance.  They  however  have  both 
the  advantage  of  being  independent  of  the  fusion  network  architecture  and  the 
information  flow.  This  makes  them  more  widely  applicable  than  the  two 
methods  presented  below. 

1 .4.3  Estimation  of  the  cross  covariance 

Another  solution  consists  in  estimating  the  missing  cross  covariance  matrix,  to 
allow  for  the  application  of  the  general  form  of  the  Kalman  filter  given  by  the 
equations  (13)-(15).  An  example  of  algorithms  for  computing  the  cross 
covariance  matrix  is  given  by  the  weighted  covariance  method  [16, 17].  Since 
maintaining  such  a  covariance  matrix  is  not  possible  in  any  arbitrary 
architecture  [18],  this  method  is  only  applicable  in  the  case  of  “small” 
networks,  where  the  information  flow  is  well  defined. 

1 .4.4  Removal  of  the  redundant  information 

Since  the  inconsistency  phenomenon  is  mainly  caused  by  the  double  counting 
of  the  redundant  information,  an  interesting  solution  consists  in  removing  this 
redundancy.  The  tracklet  fusion  approach  [19, 20]  and  the  information  filter 
method  [2 1  ]  are  two  very  practical  methods  that  use  very  similar  algorithms  to 
achieve  this  task.  Due  to  the  amount  of  information  required  for  their 
implementation,  these  methods  are  also  only  applicable  in  the  case  of  “small” 
networks,  with  a  known  information  flow. 


1 .5  Application  to  track  fusion 

To  allow  for  the  comparison  of  the  above-described  methods,  an  application  to  the 
target’s  tracking  problem  is  considered.  This  comparison  is  mainly  based  on  the 
estimation  accuracy  and  consistency.  Figure  1  gives  the  architecture  of  the  fusion 
network  considered.  Each  local  node  has  its  own  fusion  mechanism  that  generates  an 
estimate  (or  a  track)  based  only  on  its  locally  available  measurement  data  (or  contacts). 
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Figure  1:  Fusion  network  architecture 


We  assume  that  both  nodes  send  their  tracks  and  contacts  to  the  central  node  that  fuses 
them,  in  some  way,  to  obtain  a  combined  track.  Such  a  tracking  problem  presents  both 
of  the  above-mentioned  situations,  that  is,  independent  and  correlated  source  fusion 
problems.  The  independent  source  case  occurs  at  the  sensor  level,  where  the  fused 
contacts  are  actually  independent.  As  shown  in  Chapter  2,  this  problem  can  be 
optimally  solved  by  the  standard  Kalman  filter. 

The  correlated  source  situation  is  encountered  at  the  central  tracker  level.  The  case, 
where  the  latter  uses  only  the  contacts,  and  ignores  the  local  tracks,  is  known  as  the 
contact-level  fusion,  and  falls  within  the  independent  source  category.  The  standard 
Kalman  filter  can  therefore  optimally  solve  it.  Furthermore,  since  it  yields  the  best 
performance  (by  using  the  standard  Kalman  filter),  it  will  serve  as  a  reference  to 
evaluate  the  performance  of  the  presented  methods.  A  more  challenging  problem  occurs 
however  when  the  central  node  fuses  the  sensor-level  tracks,  instead  of  the  contacts. 
Since  the  sensor-level  trackers  share,  at  least,  the  same  process  noise,  their  tracks  are 
correlated.  The  predicted  estimate  of  the  central  tracker  is  also  correlated  with  each  of 
these  sensor-level  tracks,  since  they  share  the  same  error  history.  This  problem  of 
track-level  fusion  falls  therefore  within  the  correlated  source  case  (see  Chapter  3). 

This  report  is  organized  as  follows.  The  Kalman  filter  is  first  introduced  in  Chapter  2, 
as  an  optimal  solution  to  the  contact-level  fusion  problem.  In  Chapter  3  is  presented  the 
track-level  fusion  problem.  The  inconsistency  of  the  simple  fusion  is  shown,  and 
alternative  solutions  are  presented.  In  Chapter  4,  these  solutions  are  compared  for  the 
target's  tracking  problem.  The  conclusion  is  presented  in  Chapter  5.  Some  useful 
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materials  and  further  developments  will  also  be  presented  in  Appendices  A  and  B. 
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2.  Contact-level  fusion 


To  illustrate  the  contact-level  fusion  problem,  the  estimation  of  the  target’s  kinematic 
properties  will  be  considered.  In  such  a  context,  the  contact-level  fusion  consists  in 
combining  each  new  observation  with  the  available  estimate  of  the  target’s  state  vector, 
to  provide  an  “improved”  estimate  of  the  actual  target’s  kinematics.  Since  each 
observation  is  statistically  independent  from  the  others  and  from  the  maintained  state 
estimate,  the  fusion  problem  falls  within  the  independent  source  class.  Therefore,  as 
discussed  in  Chapter  1,  the  Kalman  filter  provides  an  optimal  solution. 

2.1  Target’s  dynamical  model 

The  dynamics  of  a  target,  whether  it  is  an  aircraft,  a  missile  or  a  ship,  can  be  described 
by  the  evolution  of  its  state.  The  latter  refers  to  a  set  of  variables  x  that,  at  a  specific 
instant  of  time  k,  describe  the  target’s  kinematic  properties,  which  are  partially  reported 
by  a  sensor  or  a  set  of  sensors.  Besides  the  target  position  estimate  (e.g.,  range  and 
bearing,  bearing  and  elevation,  etc.),  the  reported  information,  which  is  commonly 
referred  to  as  a  contact,  may  also  contain  a  time  tag,  an  estimate  of  the  measurement 
quality  (S/N  ratio,  variance  estimate,  etc.)  and,  potentially,  target  identity  information 
data  (e.g.,  IFF  reply  data).  The  target’s  dynamical  behavior  is  often  modelled  using  the 
dynamical  equation 


x/j^-i  —  Fkxk  -F  Gkuk  T  vk  (16) 

This  equation,  known  as  the  linearized  state  equation,  may  be  prone  to  random 
disturbances  v,  resulting  from  the  model  simplification2  and/or  the  target’s  maneuvers. 
The  matrix  Fk  and  Gk  are  respectively  the  state  transition  matrix3  and  the 
control/cahbration  gain  matrix.  The  equation  (16)  tells  how  the  future  state  vector  x^+i 
of  the  target  evolves  from  its  current  value  x*.  when  it  is  affected  by  the  control  uk  and 
the  process  noise  v k.  In  practice,  the  individual  state  variables  x  cannot  always  be 
determined  exactly  by  direct  measurements.  The  observations  usually  provide  only  a 
partial  information  about  the  complete  state,  i.e.,  they  are  ’’incomplete”  observations. 
Furthermore,  since  the  sensors  do  not  provide  perfect  data,  the  measurements  (or 
contacts)  are  often,  if  not  always,  corrupted  by  random  noises  w 

zk  =  Hkxk  +  wk  (17) 

This  equation  is  known  as  the  linearized  measurement  (or  observation)  equation,  where 
Hk  is  the  observation  matrix. 

The  tracking  problem  then  consists  in  combining  the  predicted  state  vector  xfc+1|fc  and 
the  newly  available  data  zk+x,  to  provide  a  refined  estimate  xfc+1n.+1  of  the  state  vector. 

2The  objective  of  the  model  is  to  represent  only  the  dominant  modes  of  the  dynamics. 

3For  non-linear  systems,  the  matrices  Fk,  Gk  and  Hk  are  the  Jacobians,  obtained  from  the  partial  derivatives  of 
the  actual  non-linear  dynamics. 
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The  measurement  noise  w  and  the  process  noise  v  are  assumed  zero-mean,  that  is. 


E 


Wk 


=  0  and  E 


and  not  auto-,  z.e.. 


E 


wkwf 


nor  cross—,  i.e.. 


E 


vkwf 


Vk 


=  0 


=  RS(k  —  l)  and  E 


vkv{ 


Q5(k  -  l ) 


0,  Wk,  l 


(18) 


(19) 


(20) 


correlated.  Under  these  assumptions,  the  Kalman  filter  provides  the  best  unbiased 
estimate  x*.+1|fc+1  of  the  actual  state  xk+i,  given  the  statistics  of  the  noises  v  and  w. 


2.2  Kalman  filter 

Within  the  Kalman  filtering  framework,  the  fusion  problem  can  be  reformulated  as  a 
linear  combination  of  the  a  priori  estimate  xk+i\k  of  the  state  Xfc+i  and  the  measured 
variable  zk+ 1-  These  represent  the  (independent)  pieces  of  information  to  be  fused,  and 
whose  fusion  results  in  the  updated  (or  a  posteriori )  estimate  Xfc+i|fc+i  given  by 


®fc+l|fc+l  —  ^x*fc+l|fc  "h  'WZXZ 
From  (9)  and  (10),  the  Kalman  gains  are  rewritten  as 


Wx  = 

wz  = 


p- 1  _L  p-1 


A+llfc  + 


-1 


p-i 
l\k 


-1 


where 


■Pfc+i|fc  =  E 


(•^fc+l|fc  *fc+l)  ^fe+l) 

L 

is  the  a  priori  estimation  error  covariance  matrix4,  and 

Pz  =  E 


-  ~T 
xzxz 


(21) 

(22) 

(23) 

(24) 

(25) 


is  the  error  covariance  of  the  (indirectly)  measured  state.  The  combined  estimate 
covariance  is  then  rewritten  as 


k-\-l\k+l 


p-1  I  p-1 


(26) 


4This  is  the  predicted  value  of  the  covariance  at  time  instant  k  +  1.  based  on  observations  up  to,  and  including, 
the  time  instant  k. 
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2.2.1  Covariance  computation 

The  a  priori  estimation  error  is  given  by 

~  ^k+l\k  ~  *cfc+ 1 
—  FkXk  Vk 


(27) 

(28) 


Pk-ki\k  7? 


which  leads  to  the  following  a  priori  covariance  matrix 

t\ 


(FkXk  ^k)(^FkXk  ^k} 

FkE 


-  ~T 
xkxk 

Fk  +E 

Vkv[ 

~FkE 

T 

XkV  k 

-e\ 

-T 

vkxk 

F’k 


(29) 

(30) 


Under  the  error/noise  independence  assumption,  the  last  two  terms  are  zero, 
and  the  covariance  reduces  to 


Pk+\\k  —  FkPk\kFk  +  Q 


(31) 


where  Pk\k 's  the  value  at  time  instant  k  of  the  assumed  a  posteriori 
covariance  matrix.  Now,  even  if  the  state  is  (in  general)  not  directly  accessible 
to  the  measurement,  its  expression  will  be  used  to  compute  the  measurement 
emor  covariance  matrix.  The  available  information  about  the  target’s  state  is 
contained  in  the  observation  vector  zk+\  that  is  related  to  the  state  by  the 
observation  equation  (17).  The  (non-completely)  measured  state  can  then  be 
expressed  as  follows 

xz  =  H^zk+i  (32) 

=  ccfe+1  +  H^llwk+ 1  (33) 


The  measurement  error  is  then  given  by 
Xz  =  HkllW> e+l 

The  covariance  of  the  measurement  error  can  be  written  as 


P*  =  E 


[( HkllwM)iHk+lwk+l)J 

- 

which  can  be  expressed  in  the  information  (inverse)  space  as 


hUr'h, 


k+ 1 


(34) 


(35) 

(36) 


(37) 
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2.2.2  Inverse  form 

Gathering  the  equations  (21)  to  (37)  leads  to  the  following  algorithm  for  the 
Kalman  filter,  known  as  the  inverse  form.  This  is  very  useful  representation, 
also  known  as  the  information  space  representation. 

r  i  -i 

■^A:+l|fc+l  =  FkPk\kFk  +  Q  T-  Hk+ill  Hk+ 1  (38) 

r  i -1  r  i 

^k+l\k+l^k+l\k+l  =  PkPk\kFk  +  Q  Fk&k\k  +  GkUk  +  Hfc+iR-1  Zk+I  (39) 

2.2.3  Direct  form 

Another  representation  of  the  Kalman  filter,  known  as  the  direct  form  or  the 


covariance  space  representation,  can  be  obtained  by  considering  the 
expression  of  the  a  posteriori  covariance  matrix 

~  **k+ i|Jt  +  Hk+ \R  lHk+ 1  (40) 

to  which  is  applied  the  following  matrix  inversion  lemma. 

(A-1  +  BDC)~l  =  A  -  AB(CAB  +  D-l)~lCA  (41) 

This  results  in 

1  -l 

-^c+i|fc+i  =  -Pfc+i|fc  -Pfc+i|fcT/fc+1  Hk+\Pk+i\kHk+\  R  Pk+iPk+i\k  (42) 

=  Pk+i\k  ~  Wk+iHk+iPk+\\k  (43) 

where 

-i -l 

Wfc+1  =  Pk+i\kH'k+i  P^k+  iPk+i\kHk+i  +  R  (44) 

=  PkU  +  W[+lR-iHkJ  XHl+lR -1  (45) 

- 

—  Pk+\\k+\Pfk+\R  1  (46) 

is  what  is  commonly  referred  to  as  the  Kalman  gain  matrix.  From  equations 
(21)  and  (26),  the  a  posteriori  estimate  can  then  be  expressed  as 

*fc+i|fc+i  =  -Pfc+i|fc+i  ”b  Pz  xz  (47) 

=  xk+l\k  T"  Pk+l\k+\Pz  XZ  ~  xk+l\k  (48) 

=  ®fc+i|fe  +  Pk+\\k+\PzlHkli  zk+ 1  -  Hk+\xk+l]k  (49) 
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Using  equations  (37)  and  (46),  the  above  update  rule  is  rewntten  in  the 
following  form 


*fc+ 1  —  *fc+  l|fc  zk+ 1 


Grouping  together  equations  (31),  (43),  (44)  and  (50)  leads  to  the  well-known 
“prediction-update  cycle”  (or  the  direct)  form  of  the  Kalman  filter. 


Prediction 


■Efc+l|fc  Fk^k\k  T  GkUk 

Pk+l\k  =  FkPk\kFk  +  Q 


Update 


Wfc+ 1  —  Pk+i\kP^k+i  Hk+lPk+MkHl+l  +  R 


^fc+l|fc+l  —  &k+l\k  T  zk+ 1  FIk+l&k+l\k 


■Pfc+llfc+l  —  \I~Wk+1Hk+1\  Pk+l\k 


2.2.4  Innovation  form 

Another  widely  used  form  of  the  Kalman  filter  uses  the  innovation5  (is)  and  its 
covariance  matrix  ( S ).  This  allows  rewriting  the  Kalman  filter  as  given  below. 


Prediction 


Innovation 


Update 


^k+l\k  —  FkXk\k  +  Gkuk 

Pk+l\k  FkPk\kFk  +  Q 


Vjk- hi  zk+l  Rk-\-l^k^-l\k 

^fc+i  Hfc+iA+ilfcHfc+i  +  R 


Wk+1  =  Pk+i\kHl+1 

^k+ 1 

®fe+l|/c+l  =  *fe+l|fc  +  Wk+lVk+1 

Pfc+l|fc  +  l  =  -Pfc-Ulfc  —  Wfc+1  Sk+-[  W^J- 


'k+l^k+1  wfc+1 


5Or  the  residual. 
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2.3  Single  sensor  target  tracking 

In  the  case  of  a  single  sensor  configuration,  the  tracking  can  be  performed  using  any 
one  of  the  above-given  forms  of  the  Kalman  filter.  These  forms  all  lead  to  the  same 
(optimal)  solution,  given  that  the  independence  assumptions  are  satisfied. 

In  the  architecture  of  Figure  1,  the  single  sensor  configuration  is  used  within  the 
sensor-level  trackers.  This  represents  the  simplest  case. 


2.4  Multi-sensor  target  tracking 

When  a  centralized  multi-sensor  fusion  architecture  is  used,  each  individual  sensor 
transmits  (with  negligible  delay  through  large  bandwidth  communication  links)  its  raw 
observations  to  the  fusion  centre  where  the  required  processes  are  performed  to 
generate  and  update  global  tracks,  within  a  single  master  track  file  [8].  The  central 
fusion  process  performs  the  functions  of  data  alignment,  data  association  and  target 
state  estimation.  Because  of  the  actual  independence  of  the  fused  contacts,  the 
contact-level  fusion  approach  yields,  as  in  the  single  source  case,  an  optimal 
performance  by  using  the  standard  Kalman  filter.  There  are  however  three  different 
solutions  possible  to  fuse  the  independent  contacts  received  by  the  central  tracker  from 
the  sensors.  Their  performances  are  very  similar  (and  even  identical  in  the  linear  case) 
and  only  the  computation  requirements  may  differ  from  one  solution  to  another  [22], 


2.4.1  Sequential  fusion 


A  Kalman  filter,  as  in  the  case  of  a  single  sensor  configuration,  treats  all  the 
measurements  sequentially.  The  fusion  of  these  measurements  is  however 
performed  without  a  prediction.  Only  one  prediction  is  computed  for  all  the 
received  (at  the  same  time)  measurements. 

For  the  first  sensor 


p-i 

fc+i|fc+i 


-Ffc-Pfc|fc-F*T  +  Q 


+  HJ 


Pk^k\k  "F 


r 

^1 


RT1^ 


(*+D 


(fc+i) 

Hi 


<fc+i) 


Rk&k\k 


(63) 

(64) 


For  the  others  (i  =  2  to  N) 


3-t 

fe+i|fe+i 


=  P, 


-l 


fc+ilfc-t-i 


+  H, 


fifc+D  * 


R7lH 


*<fc+U 


*fc+i|fc+i  =  £fc+iifc+i  +  Pk+i\k+iHf(k+l)Rt 


Zt(k+i)  ■^t(fc+i)*fc+ilfc+i 


(65) 

(66) 
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2.4.2 


Parallel  fusion 

This  method  is  based  upon  the  use  of  a  stacked  vector  of  the  measurements  to 
process  them  in  parallel.  A  composite  equation  is  defined  by 

Zk+ 1  =  Hk+1xk+i  +  wk+ 1  (67) 


where 


and 


Zk+ 1  = 
Hk+i  = 
Wk+l  = 


fifc+i) 


i  ■  *  *  j  zNi 


(fc+i) 


h 


,^1V, 


(M-l) 


i?  =  diag 


R\ ,  ■  •  ■ ,  -Rtv 


(68) 

(69) 

(70) 


(71) 


These  matrices  and  vectors  are  used  as  inputs  (and  parameters)  to  a  standard 
Kalman  filter. 


p- 1 

-'jt+ilfc+i 


FkPk\kFk  +  Q 


+  Hl+1R-lH, 


/c-f-1 


& FkXk\k  -P/c-f  l|/c-h  1 


Zk~\r  1  l-f/c*^/c|/c 


(72) 

(73) 


2.4.3  Data  compression 

All  the  contacts  {zt(^k+1),Rt)  from  the  different  sensors  are  first  fused  together 
to  form  unique  vector  zk+l  and  covariance  R,  of  the  same  dimension  as 
zl(fc+1)  and  Ri  respectively.  The  obtained  information  is  used  as  a  unique 
contact  by  a  central  Kalman  filter.  The  compression  algorithm  is  given 

n 

R~l  =  Y,Kl  (74) 

i=l 

n 

R-'zk+l=Y,R7lzHk^  (75) 


Note  that  the  data  compression  and  the  parallel  fusion  apply  only  in  the  case 
of  synchronous  systems,  i.e.,  all  the  contacts  from  the  sensors  are  received  at 
the  same  time.  The  sequential  fusion  can  be  used  in  either  synchronous  or 
random  transmission  cases.  A  different  prediction  mechanism  is  however  used 
in  the  random  case.  From  the  computation  requirement  viewpoint,  the  data 
compression  is  the  most  efficient,  while  the  parallel  fusion  is  the  least  [22]. 
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2.5  Benefits  of  contact-level  fusion 

One  advantage  of  the  contact-level  (or  centralized)  fusion  architecture  is  the  increased 
reaction  time  [8].  Track  initiation,  confirmation  and  reporting  are  much  quicker  with 
the  centralized  approach.  All  sensors  that  detect  a  target  are  used  to  initiate  a  track  on 
the  target  and  contribute  to  the  promotion  of  the  track  to  the  status  of  firm.  Also,  the 
mutual  support  provided  by  the  various  sensors  reduces  the  number  of  ’’holes”  in  the 
data  due  to  sensor  fades  (e.g.,  radar  fade  zones  or  IR  sensor  blockage).  Moreover,  the 
aggregate  scan  period  of  the  suite  of  sensors  is  significantly  less  than  the  fastest  sensor. 
For  example,  if  a  sensor  is  in  a  10  seconds  scan  mode  and  another  sensor  is  scanning 
the  same  volume  at  the  rate  of  once  every  10  seconds,  then  the  average  update  rate  for  a 
target  being  seen  by  both  sensors  is  once  every  5  seconds.  Hence,  each  composite  track 
contains  more  data  per  unit  of  time  than  the  corresponding  sensor-level  tracks.  Thus,  by 
using  raw  detections  from  all  sensors  for  each  track,  the  probability  of  confirming  the 
track  can  be  improved  over  that  for  a  single  sensor.  The  increased  reaction  time 
translates  into  longer  range  at  target  detection  and  track  confirmation.  Clearly,  this  is  of 
high  interest  in  a  military  environment. 

The  contact-level  fusion  architecture  has  also  the  advantage  of  good  track  continuity.  In 
hard  environmental  conditions,  each  individual  sensor  may  have  a  hard  time  to  sustain  a 
track.  However,  looking  at  the  overall  sensor  suite,  one  sensor  may  be  blocked  while 
another  has  contact  with  the  target  being  tracked.  Hence,  with  multiple  sensors 
updating  a  track,  the  probability  is  small  that  all  sensors  are  experiencing  a  fade  at  the 
same  point  in  space  and  time.  It  can  typically  be  seen  that  one  sensor  ’’fills  the  gaps”  of 
the  other  sensor’s  fade  zones  and  that  the  combined  probability  of  detection  is  better 
than  the  maximum  probability  of  each  sensor  at  each  range.  For  example,  in  a  system 
with  a  radar  and  an  infrared  (IR)  sensor,  IR  detections  can  maintain  a  track  that  might 
otherwise  be  lost  during  a  fade  in  the  radar  return  [17].  The  probability  of  sustaining  a 
track  is  thus  increased  over  that  for  a  single  sensor  by  using  raw  contacts  from  all 
sensors.  Finally,  as  an  additional  factor  that  contributes  to  the  track  continuity,  each 
composite  track  contains  more  data  per  unit  of  time  than  the  corresponding  sensor-level 
tracks.  The  data  from  each  sensor  is  used  immediately  to  confirm  target  maneuvers 
before  the  track  is  lost  or  corrupted  [8]. 

Use  of  the  maximum  available  information  in  the  centralized  architecture  results  in  less 
track  uncertainty,  and  potentially  a  corresponding  decrease  in  mis-correlation  [5, 8, 17]. 
For  example,  there  will  be  a  higher  probability  of  correct  correlation  in  areas  affected 
by  clutter  because  the  gate  sizes  will  be  smaller  due  to  more  frequent  track 
updates  [17].  Furthermore,  since  the  data  from  each  sensor  is  used  immediately  to 
confirm  target  maneuvers  before  the  track  is  lost  or  corrupted,  the  contact-level  fusion 
approach  should  have  good  false  track  suppression  [8],  Moreover,  a  centralized  fusion 
system  must,  by  necessity,  incorporate  advanced  clutter  suppression  algorithms  to 
offset  the  increased  data  rate  available  from  multiple  sensors  [8].  These  algorithms  are 
specifically  designed  to  suppress  the  types  of  clutter  encountered  by  maritime 
surveillance  sensors  (sea,  weather,  chaff  and  land  clutter).  Finally,  as  presented  above, 
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tracking  algorithms  conceptually  similar  to  single-sensor  tracking  algorithms  can  be 
used  to  implement  centralized  fusion  [5]. 

2.6  Drawbacks  of  contact-level  fusion 

The  contact-level  fusion  approach  suffers  primarily  from  the  large  communication  load 
resulting  from  the  amount  of  raw  observation  data  that  must  be  transferred  from  the 
sensors  to  the  central  processor  through  a  high  bandwidth  communication  link.  The 
computer  processing  power  required  to  centrally  process  this  raw  data  may  also  be  very 
high.  Other  potential  problems  with  the  centralized  fusion  relate  to  military 
environments  [5].  Centralized  systems  are  highly  vulnerable  to  failure  (or  destruction) 
because  of  the  critical  nature  of  the  central  node  in  such  architecture.  From  a  tactical 
perspective,  because  it  represents  a  physically  large,  easily  recognized  critical  element 
in  the  intelligence  preparation  and  dissemination  processes,  a  centralized  system  is 
highly  vulnerable  to  attack  [10].  Hence,  the  centralized  approach  requires  backup 
processing  and  track  files  for  survivability  in  case  the  platform  containing  the  central 
track  file  fails  [8],  Centralized  systems  are  also  vulnerable  to  degraded  (or  corrupted) 
sensor  data.  This  problem  occurs  when  the  data  from  one  sensor  can  become  degraded 
(and  this  degradation  not  immediately  sensed),  and  thus  lead  to  poor  central-level 
tracking.  In  this  case,  the  possible  combination  of  good  data  from  un-degraded  sensors 
with  bad  data,  in  effect,  will  negate  the  value  of  the  good  data  [23], 

With  the  contact-level  fusion  architecture,  one  seeks  to  determine  if  raw  data  are 
observations  of  the  same  entity.  This  data  association  process  may  be  difficult  because 
of  the  large  amount  of  data  that  need  to  be  processed  simultaneously,  and  because  of 
the  dissimilarity  between  the  sensors.  Even  the  association  of  identical  sensors  may  be 
difficult  if  the  sensors  are  displaced  geographically.  Fusion  of  raw  data  requires 
commensurate  sensor  data  [9].  Commensurate  sensors  observe  the  same  physical 
manifestation  of  an  entity.  Examples  of  commensurate  sensors  include  identical  sensors 
or  sensors  whose  observational  data  may  be  closely  compared  or  merged  (e.g.,  an 
infrared  image  and  a  visual  image).  Finally,  the  implementation  of  the  centralized 
fusion  architecture  typically  requires  modifications  to  the  current  autonomous  sensors 
already  in  use  to  gain  access  to  the  raw  contact  data.  These  modifications  may  be  costly. 
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3.  Track-level  fusion 


The  track-level  (or  decentralized)  fusion  architecture  allows  each  sensor  to  perform  a 
maximum  amount  of  pre-processing  to  generate  sensor  output  decisions  (such  as  state 
vectors  and  declarations  of  identity)  for  the  various  entities  in  the  environment  [9]. 
Independent  target  detection,  features  extraction,  state  estimation  and  identification  are 
thus  potentially  performed  within  the  signal  processor  and  tracker  of  each  sensor  [8]. 
The  resulting  target  track  data  is  normally  stored  in  a  track  file.  Hence,  each  sensor 
individually  maintains  its  own  track  file  based  exclusively  upon  its  own  measurement 
data  processed  by  the  local  tracker  [23].  These  sensor-level  tracks  are  then  transmitted 
to  a  central  fusion  process  responsible  for  both  finding  the  sensor  tracks  that  likely 
represent  the  same  target,  and  for  combining  or  fusing  these  tracks  into  composite 
tracks  to  form  a  master  track  file.  Within  the  central  fusion  process,  data  alignment, 
gating,  assignment  and  fusion  (positional  and/or  identity)  are  performed  on  state 
vectors  rather  than  on  raw  data. 


3.1  Track-level  fusion  algorithms 

Fundamental  to  the  problem  of  combining  sensor-level  tracks  is  to  first  determine 
whether  two  tracks  from  different  systems  ( i.e .,  different  sensor  track  files)  potentially 
represent  the  same  target  [23].  To  accomplish  this  parametric  association  process,  one 
must  define  for  each  track-to-track  pairing  an  appropriate  association  metric  that 
quantifies  the  closeness  of  the  tracks.  With  the  use  of  the  Kalman  filtering,  the 
association  metric  can  be  a  statistical  distance  applied  to  the  track  state  vector 
differences  for  the  two  tracks.  However,  because  the  process  noise  introduced  by  the 
target  behavior  is  observed  by  all  sources  tracking  a  common  entity,  Bar-Shalom  [6] 
has  shown  that  the  track  estimation  errors  may  be  correlated,  and  that  this  correlation 
must  be  considered  in  the  association  metric.  After  track-to-track  associations  have 
been  determined,  the  local  tracks  that  correspond  to  the  same  targets  as  seen  by 
different  sensors  must  eventually  be  combined  at  a  later  stage. 

Nevertheless,  if  the  central  track  is  updated  with  sensor-level  tracks,  the  usual 
assumption  (valid  for  the  case  of  raw  measurements  with  uncorrelated  measurement 
error)  of  error  independence  from  one  update  period  to  another  is  not  valid.  The 
dependence  between  the  estimation  errors  from  the  track  files  arises  from  the  common 
process  noise  entering  into  the  state  equation  of  the  tracking  filters  (i.e.,  the  common 
error  source  due  to  the  target  dynamics),  given  that  the  information  processors  follow 
the  same  target.  For  example,  a  sudden  target  maneuver  can  lead  to  a  bias  error  for  all 
the  tracking  filters.  The  fact  that  the  measurement  noise  sequences  processed  by  these 
different  filters  can  be  assumed  independent  is  not  sufficient  to  ensure  the  independence 
of  the  estimation  errors  in  the  track  files.  The  tracks  dependence  can  be  taken  into 
account  in  the  processing,  but  it  forces  additional  complexity  [6, 23].  Techniques  for 
combining  sensor-level  tracks  into  a  global  track  file  are  described  in  many 
references  [6, 9, 10, 17, 23].  The  next  sections  give  an  overview  and  a  comparative 
study  of  most  of  the  reported  techniques. 
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3.1.1  Best  track 

This  is  the  simplest  way  to  obtain  a  global  track  from  the  sensor-level  tracks. 
It  consists  in  choosing,  according  to  some  decision  strategy,  the  best  among 
all  the  available  tracks.  One  approach  consists  in  selecting  the  sensor-level 
track  that  yields  the  smallest  (norm  of  the)  error  covariance  matrix.  Since  this 
method  uses  only  one  track  at  time,  it  does  not  take  advantage  of  the 
information  contained  in  the  other  tracks,  that  is,  the  information  brought  by 
the  other  sensors.  In  this  case,  if  one  sensor  is  slightly  more  accurate  than  the 
others,  the  central  track  will  reduce  to  the  track  generated  by  the  tracker 
associated  with  that  sensor.  Since  it  does  not  take  advantage  of  the  available 
fusion  architecture,  the  performance  of  the  resulting  fusion  will  correspond  to 
that  of  single-sensor  architecture. 


3.1.2  Simple  fusion 

The  simple  fusion  method,  where  the  sensor-level  tracks  are  assumed 
independent,  is  another  simple  way  to  generate  global  tracks.  As  a 
consequence  of  the  independence  assumption,  a  standard  Kalman  filter  is  used 
in  the  central  tracker.  The  (assumed  independent)  sensor-level  tracks  are  then 
simply  treated  as  contacts,  with  the  identity  as  an  observation  matrix.  This 
approach,  whose  algorithm  is  given  below,  suffers  from  inconsistency. 


Prediction 


*^lc4-l|lc  —  Pk*^k\k  T  G'k'U'k  (76) 

-Pfc+l|fc  —  FkPk\kFk  +  Q  (77) 


Update 


p- 1  _  p-t 

fc+l|fc+l  A:+l|fc 

=  P; 


+  Pr1  +  A-1 

Mfc+i)  2(fc+i) 


fc+l|fc+iaSfe+1lfe+1  *^k+l\kXk+l\k 


-1 


4(fc+i) 


(78) 

(79) 


This  filter  overestimates  its  own  performance,  by  underestimating  the  actual 
error  covariance  matrix.  This  inconsistency  may  lead  the  filter  to  instability,  if 
the  latter  is  applied  for  recursive  estimation.  This  is  why  alternative  methods 
are  presented  below. 


3.1.3  Covariance  intersection 

The  covariance  intersection  provides  a  method  that  allows  performing  the 
track6  fusion  without  assuming  independence.  The  “intersection”  terminology 
is  related  to  the  geometric  analogy  based  upon  the  covariance  cr-contour  plots. 

6And  correlated  data,  in  general. 
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By  using  a  Kalman-like  fusion  rule,  the  actual  error  covariance  will  always  lie 
within  the  region  defined  by  the  intersection  of  the  covariance  of  the  fused 
sources,  whatever  is  the  degree  of  correlation  between  these  sources  [14]. 

Based  on  this  observation,  and  in  order  to  guarantee  the  consistency,  the 
covariance  intersection  algorithm  computes  a  covariance  matrix  that  will 
always  enclose  the  intersection  region.  The  latter  is  in  fact  an  upper  bound  for 
the  actual  covariance.  In  the  case  of  two  sensor-level  tracks,  (®i,  Pi)  and 
(x2,  P2),  the  central  fusion  algorithm  is  given  by. 

Prediction 

£fc+i|fc  =  -Ffc£fc|fc  +  GkUk  (80) 

Pk+i\k  =  FkPk\kFk  +  Q  (81) 

Update 

A=+I|fc+1  =  +  Wli\fc+ 1)  +  (fc+1)  (82) 

^ilfc+i^+ilfc+i  =  +  "1- Pi(t+1)*hk+D  +  ^P^xv+i)  (83) 


Subject  to 


wo  +  cui  +  u>2  =  1  (84) 

Wj  >  0,  Vj  (85) 

The  parameters  cuj  provide  additional  degrees  of  freedom  that  allow  one  to 
perform  a  further  optimization  of  (a  some  norm  of)  the  combined  covariance 
matrix. 

Since  the  intersection  region  represents  (in  all  directions)  an  upper  limit  for 
the  actual  covariance,  and  the  covariance  intersection  method  overestimates  it, 
the  latter  results  in  a  significant  loose  of  performance.  This  is  why  the  method 
is  said  sub-optimal.  To  avoid  this  large  overestimation  of  the  actual  covariance 
matrix,  we  proposed  in  [15]  a  new  filter  called  largest  ellipsoid,  which  is 
briefly  presented  below. 

3.1 .4  Largest  ellipsoid 

As  in  the  covariance  intersection  case,  the  design  of  the  largest  ellipsoid  filter 
is  based  on  the  estimation  of  the  intersection  region.  But  instead  of 
overestimating  it,  the  proposed  filter  tries  to  slightly  underestimate  it.  This 
will  have  no  consequence  on  the  consistency  of  the  filter,  because  the 
intersection  region  is  only  an  upper  limit.  Since  the  rr-contour  defined  by  the 
actual  covariance  matrix  is  an  ellipsoid,  the  largest  ellipsoid  filter  computes 
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the  largest  ellipsoid  contained  within  this  intersection  region.  The  matrix 
orientation  problems  may  however  render  the  computation  of  this  intersection 
very  difficult,  and  even  impossible.  This  is  why  the  following  geometrical 
transformations  are  first  applied  to  the  covariance  matrices  and 

Po 

2(k  + 1)' 


no..  o 


where  A^  and  v\  are  respectively  the  y*  eigenvalue  and  eigenvector  of 
Pi(fc+i) .  The  shape  and  the  size  of  the  intersection  ellipsoid  are  then  defined 
by  the  following  matrix 


E^T-1  [V2l 


v2n]  D 


mm 


(86) 


which  will  serve  as  the  error  covariance  matrix  -Ffc+i|A:+i  for  the  central  track. 
The  matrix  Drmn  is  defined  by 


min(Ai1,A2l)  0  ...  0 

0  mm(Ax1,A22)  ...  0 

0  0  ...  min(All,A2n) 


(87) 


where  A2  and  v2j  are  respectively  the  yth  eigenvalue  and  eigenvector  of  the 
transformed  matrix 


J°2=TA(*+1)rT  (88) 

Besides  the  computation  of  the  largest  ellipsoid  matrix,  a  simple  fusion 
algorithm  is  run.  The  resulting  state  vector  estimate  (79)  is  kept,  while  the 
covariance  matrix  (78)  is  dropped  and  replaced  by  (86).  The  pair  (79)-(86) 
represents  the  updated  central  track,  and  will  serve  as  the  starting  point  for  the 
next  cycle  in  both  of  the  simple  fusion  algorithm  and  the  largest  ellipsoid 
computation. 

3.1 .5  Weighted  covariance 

An  estimate  of  the  cross  covariance  matrix  is  computed  recursively.  This 
allows  the  correlation  between  the  tracks  to  be  taken  into  account,  through  the 
application  of  the  general  form  of  the  Kalman  filter  given  by  the  equations 
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(13)-(15).  Since  the  Kalman  gains  W\  and  W2  are  computed  at  the  contact 
arrival  rate,  the  cross  covariance  matrix  has  to  be  computed  at  this  same  rate. 
An  example  of  a  recursive  computation  [16, 17],  and  the  associated  fusion 
rule,  are  given  below. 

Correlation 


I  —  W\H\ 


i-w2jh2j 


Update 


Pe 

Wk+l 

P(k+i) 


A(k+1)-nc+i+A(t+1)-(pfec+1)T 


■Pl(jt+1)  -  Pfc+l 

*l(*+i)  +  Wk+l 

pi 

■VE 

' 

D 

hfc+ij 

A(fc+1)  -  -Pfc+i 

p-1 

■VE 

A(fc+1)  -  (Pfcc+1)T 

(89) 

(90) 

(91) 

(92) 

(93) 


Since  it  requires  the  Kalman  gains  used  to  generate  the  sensor-level  tracks, 
this  method  cannot  use  the  prior  information  (predicted  from  the  central 
track),  and  serves  only  to  fuse  synchronous  sensor  tracks.  The  fusion  result  is 
therefore  not  optimal  in  the  minimum  mean  square  error  sense,  but  only  in  the 
maximum  likelihood  sense.  Furthermore,  if  the  sensor  trackers’  Kalman  gains 
are  not  available,  or  cannot  be  sent  the  central  tracker  at  the  sensor  trackers’ 
update  rate,  the  weighted  covariance  algorithm  cannot  be  implemented. 


3.1 .6  Tracklet  fusion 

This  method  is  based  on  the  removal  of  the  redundant  information  approach. 

In  the  case  of  a  fusion  without  the  process  noise,  this  method  is  proven  to  be 
optimal,  that  is,  it  is  equivalent  to  the  contact-level  fusion.  Nevertheless,  in  the 
practice  the  presence  of  this  noise  does  not  affect  much  the  performance  of  the 
method.  Since  the  sensor-level  trackers  compute  tracklets,  and  not  complete 
tracks,  the  only  available  track  is  located  at  the  central  node7.  The  sensor-level 
tracks  may  be  required  in  some  situations,  as  for  the  track  association 
problems  in  multi-target  environments.  To  solve  this  problem,  sensor-level 
trackers  will  have  to  maintain  complete  tracks  besides  the  tracklets.  This 
obviously  will  results  in  an  increased  computation  load  and  communication 
bandwidth8. 

7If  a  feedback  is  used,  the  central  node  will  also  have  to  run  a  tracklet  algorithm,  which  means  that  even  the 
central  track  will  no  longer  be  available,  unless  additional  computation  is  performed  to  also  maintain  a  complete 
track. 

8  Since  both  of  the  tracklets  and  the  tracks  are  sent  to  the  central  tracker. 
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The  method  is  illustrated  here  with  the  example  of  two  (sensor-level)  trackers 
that  send  their  tracks  to  a  central  tracker  (see  Figure  1).  For  more  than  two 
nodes,  each  pair  of  nodes  that  exchange  information  will  have  to  run  a  similar 
algorithm  to  avoid  redundancy.  It  is  clear  that,  for  a  large  number  of  nodes, 
the  implementation  may  be  difficult,  and  even  impossible;  if  the  data  transfer 
paths  are  not  known.  This  is  why  this  method  is  only  practical  in  the  case  of 
“small”  networks  with  a  known  data  flow. 

3. 1.6. 1  Tracklet  computation 

For  each  sensor-level  tracker,  a  tracklet  is  computed  at  the  end  of 
cycles  corresponding  to  a  contacts.  The  starting  time  and  the  end 
of  each  cycle  are  noted,  respectively,  l  and  k.  Take  note  that 

k  =  l  +  a  (94) 

where  a  can  be  seen  as  an  over-sampling  rate.  Since  the  same 
treatment  applies  to  both  nodes,  and  to  lighten  the  notation,  the 
subscript  corresponding  to  the  node  number  will  be  dropped. 
Starting  from  the  last  sent  tracklet  at  time  instant  l,  viz ■  ( ui.Ui ), 
and  under  the  zero  process  noise  assumption,  the  predicted  value 
(a  steps  ahead)  of  the  state  vector,  without  using  the  contacts,  is 


given  by 

&k\l  =  (95) 

Pk\i  =  $i\kUi&F\k  (96) 

where 

fc-i 

*nk  =  n  <97) 

3=1 

During  this  same  cycle,  the  filtered  state  that  does  use  the  contacts 
is  given  by 

~  fit— life— i|fc— i  ~F  FFfe  Zfc  H kPk—i^- k—\\k—\  (98) 

—  I  —  WfciTfc  Ffc_ iifc-iiic-1  +  Kkzk  (99) 

=  r,|fcu/  +  cp{z)  (ioo) 

and 

Pk\k  =  I  ~  WfciTfc  Fk-iPk-i\k-iFk-i  (101) 

=  I 'l\kUi*J\k  (102) 
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where 


fc-l  r 


l\k 


-n 


1=1 


I  —  Wj+iHj+i 


F-, 


(103) 


The  correlation  between  xk\k  and  x^i  is  computed  to  allow  for  the 
removal  of  the  redundant  information.  This  correlation  is  given  by 


E 


^k\k^k\l 


=  E 
=  E 


Xk\kU[  # 


l\k 


xku[ 


l|fc 


■■Ti\kUi*T\k 


(104) 

(105) 

(106) 
(107) 


The  idea  behind  the  tracklet  fusion  algorithm  consists  in 
generating  a  piece  of  information  (uk,  Uk),  called  a  tracklet  that, 
unlike  the  complete  track,  is  rendered  independent  of  (xtj,  L/j). 
The  independence  is  obtained  by  combining  the  above-calculated 
predicted  and  filtered  vectors  as  follows 


uk  —  * k\l  T"  K(^fc|fc  *fc|j) 

where  the  gain  k  is  chosen  such  that 


E 


ukuf 


0 


From  (95),  this  is  equivalent  to 


E 


—  Pk\l  +  K 
=  0 


Pk  |  k  Pk\l 


(108) 


(109) 


(110) 


An  obvious  choice  for  k  that  guarantees  a  zero  cross-correlation  is 
given  by 


«  =  Pk 


k\l 


Pk\l  Ek\k 


(HD 


The  resulting  tracklet  and  its  covariance  matrix  are  then  given  by 

-l 


Wfc  =  Xk\l  +  Pfc|( 


Pk\l  ~  Pk\k 


(xk\k  -  Xk\t) 


Uk  =  Pk 


k\l 


fc|i 


Pk 


-1 


Pk\l  ~  Pk\l 


(112) 

(113) 
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Because  of  their  complete  independence,  the  tracklets  from  the 
both  sensor-level  trackers  are  treated  as  contacts  by  the  central 
node,  with  an  identity  observation  matrix.  The  tracklet  algorithm, 
whose  principle  is  illustrated  by  Figure  2,  can  also  be  rewritten  in 
the  information  space.  This  leads  to  the  following  algorithm. 

Computation  (i  =  1 , 2) 


fc-1 

©< 

IF 

1! 

(114) 

U^1  —  P_1  —  $7rt/-1$71 

lk  k  i|fc  *Z|fc 

(115) 

U~lu,,  =  P_1  x,,,,  —  <F7 7'U~^ul. 

»k|fc  ‘Mfc  z|fc  n 

(116) 

Fusion 

Pk\l  =  +  Ulk  +  U2k 

(117) 

=  *llk  ^l\l  (  -*■  Ult  +  ^2fc  u2 k 

(118) 

Re-initialization 

P  —  u 

r*i|i 

(119) 

*»1|I  ~  Ulk 

(120) 

3.1.7  Information  filter 

As  shown  in  Figure  3,  the  information  filter  method  is  very  similar  to  the 
tiacklet  fusion  approach  (Figure  2).  The  information  filter  is  however  more 
general,  since  it  does  not  assume  the  process  noise  to  be  null.  This  approach 
yields  an  optimal  fusion  of  tracks  and,  in  terms  of  performance,  is  equivalent 
to  the  contact-level  fusion.  Besides  the  process  noise  assumption,  the  fusion 
algorithm  given  below  differs  from  the  tracklet  fusion  in  the  re-initialization 
mechanism  at  the  starting  of  each  cycle.  While  the  tracklet  fusion 
re-initializes  both  of  the  predicted  and  the  update  estimates,  the  information 
filter  re-initializes  only  the  predicted  one.  Another  difference  lies  m  the 
information  (u;,  U{)  used  for  this  re-initialization.  The  tracklet  uses  the 
previously  sent  de-correlated  tracklet,  while  the  information  filter  re-initializes 
with  the  complete  sensor-level  track. 

Besides  its  superiority  over  the  tracklet  fusion  in  terms  of  performance,  the 
information  filter  has  the  advantage  of  maintaining  complete  tracks  at  the 
sensor-level,  instead  of  tracklets  that  contain  only  partial  information.  Note 
that  the  information  removal  can  be  performed  at  either  the  sensor-level 


24 


UNCLASSIFIED 


TR  2001-224 


P518346.PDF  [Page:  41  of  75] 


UNCLASSIFIED 


Figure  2:  Tracklet  fusion  algorithm 
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trackers  or  the  central  tracker.  If  the  removal  is  ignored,  the  method  reduces  to 
the  simple  fusion. 


Redundancy  removal  (i  —  1 , 2) 


U  ' 1  -  P  1 

U  ifc 


U 


u, 


it 


.-l 


p-  ^ 


Information  fusion 

n’1  -  f  ^u1  + 

^k\l  f  f71(,  f  U2k  U2k 


where 


P]\j  - 1  _  +Q 

®  j  b  - 1  ~  - 1 


(121) 

(122) 


(123) 

(124) 


(125) 

(126) 


3.2  Benefits  of  track-level  fusion 

The  track-level  (or  decentralized)  fusion  has  the  advantage  of  reduced  communication 
requirements  when  compared  with  the  centralized  contact-level  scheme  [6, 8, 17].  The 
track-level  fusion  requires  much  less  I/O  bandwidth  to  transmit  the  data  between  the 
sensors  and  the  central  node.  The  local  tracks  are  periodically  transferred  to  the  central 
processor  rather  than  the  copious  measurement  data.  If  necessary,  the  sensor-level 
tracks  may  also  be  communicated  less  frequently  than  the  arrival  of  the  sensor  data 
( e.g .,  the  a  over-sampling  rate  for  the  tracklet  fusion  and  the  information  filter 
approaches).  The  approach  also  has  the  advantage  of  reduced  computational  loading  (in 
any  single  processor).  Certain  computational  advantages  may  result  from  the  inherent 
parallel  processing  possible  using  this  approach  [6, 17]. 

In  military  applications,  due  to  the  distributed  tracking  capabilities,  the  decentralized 
fusion  results  in  increased  survivability  when  compared  with  centralized 
systems  [5,23].  Moreover,  if  one  sensor  becomes  degraded,  its  observations  will  not 
affect  the  sensor-level  tracks  of  the  other  sensors  ( i. e. ,  the  good  sensor-level  tracks  will 
not  be  corrupted  by  the  bad  data)  [5, 23].  By  checking  the  sensor-level  tracks  with  the 
central  tracks,  one  may  be  able  to  detect  any  errors  in  the  sensors  [23].  Then,  when  the 
sensor  with  poor  data  is  finally  recognized,  the  central-level  tracks  can  be  formed  using 
only  sensor-level  tracks  from  non-degraded  sensors  [5].  The  track-level  fusion  option 
allows  also  the  fusion  system  designer  to  tune  each  sensor-specific  estimation  process 
to  the  nuances  of  that  particular  sensor’s  data  and  operating  characteristics  [4, 5, 23]. 
Data  association  for  this  architecture  is  relatively  simple,  since  the  process  compares 
state  vectors  or  identity  declarations  instead  of  raw  data  [9].  The  approach  also  allows 
data  from  non-commensurate  sensors  to  be  combined.  Finally,  the  track-level  fusion 
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Figure  3:  Information  filter  algorithm 
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architecture  offers  a  systematic  and  natural  upgrade  path  from  the  existing  surveillance 
systems.  This  is  achieved  by  using  previously  developed  single-sensor  trackers  locally, 
followed  by  the  combination  of  their  local  tracks  to  form  global  tracks. 


3.3  Drawbacks  of  track-level  fusion 

A  major  disadvantage  of  the  track-level  fusion  is  the  inherent  poor  reaction  time.  A 
target  track  is  reported  to  the  Commanding  Officer  /  Operator  only  after  one  of  the 
single  sensors  has  promoted  its  internal  track  to  the  firm  status.  Moreover,  the 
track-level  fusion  potentially  provides  a  significant  information  loss  compared  with  the 
contact-level  fusion,  since  sensor  data  are  represented  via  state  vectors  or  identity 
declarations.  The  information  processing  and  analysis  for  each  sensor  may  result  in  a 
local  optimization  rather  than  a  global  optimized  solution  [9, 10], 

Less  accurate  tracking  and  correlation  are  to  be  expected  if  sensor-level  tracks  are 
maintained.  For  example,  there  will  be  a  higher  probability  of  false  correlation  for  the 
sensor-level  tracks  in  areas  affected  by  clutter  because  the  gate  sizes  will  be  larger  due 
to  less  frequent  track  updates  [23]. 

The  major  difficulty  associated  with  the  use  of  the  decentralized  data  fusion  arises 
during  the  formation  of  global  tracks  from  sensor-level  tracks  [5J.  There  is  a 
requirement  to  correlate  and  fuse  track  data,  such  as  state  vectors,  which  are  not 
statistically  independent  due  to  potential  target  maneuvers  (representing  common  error 
sources).  It  is  necessary  in  the  track  processing  algorithms  to  account  explicitly  for 
such  dependence  [9].  If  track  fusion  occurs  without  taking  into  consideration  the 
statistical  interdependence,  then  there  will  be  a  reduction  in  the  random  error  but  the 
mean  error  due  to  target  maneuver  will  not  be  averaged  out  [5].  However,  these  issues 
are  of  importance  only  when  the  tracks  being  combined  are  of  comparable  accuracy. 
When  considering  radar,  IR,  and  ESM  sensors  the  track  fusion  process  essentially  will 
be  a  merging  of  IR  angle,  radar  range,  and  ESM  ID.  The  effect  of  the  common  error 
source  of  target  maneuver  will  not  be  a  major  issue  for  this  set  of  sensors.  Finally,  the 
track-level  fusion  architecture  can  suffer  from  a  poor  false  track  suppression  capability 
since  poor  track-to-track  correlation  ( e.g .,  for  a  maneuvering  target)  will  inevitably  lead 
to  multiple  tracks  on  the  same  target. 
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4.  Performance  comparison  of  various  trackers 


The  methods  presented  are  illustrated  and  compared  using  the  target’s  tracking 
example,  whose  fusion  network  is  shown  in  Figure  1.  One  is  interested  here  in 
providing  an  ’’improved”  estimate  of  the  state  vector,  such  that  the  target’s  kinematics 
can  be  depicted  as  correctly  as  possible.  This  tracking  problem  presents  both  of  the 
independent  and  correlated  source  fusion  problems.  But  since  the  independent  source 
case  admits  the  standard  Kalman  filter  as  an  optimal  solution,  the  emphasis  will  be  put 
on  the  more  challenging  correlated  case,  i.  e. ,  the  track-level  fusion. 

The  tracked  target  is  assumed  to  be  moving  in  a  2D  space,  where  the  acceleration  acts 
as  an  input9.  The  state  to  be  estimated  is  therefore  composed  of  the  target’s  coordinates, 
viz.,  the  position  and  the  linear  velocity.  With  the  following  state  variable  notation 


x  = 


Px 
Py 
Vx 
V ■ 


y  J 


and 


v  = 


the  equations  of  such  a  target  can  be  expressed  as 


(127) 


*fc+i  =  Fkxk  +  Tvfc 


(128) 


where  v  is  vector  of  random  variables  that  reflects  the  unforeseeable  variation  of  the 
acceleration  in  both  directions  and  the  state  transition  matrix  is  given  by 


Fk  = 


1 

0 

0 

0 


0  h 
1  0 
0  1 
0  0 


0 

h 

0 

1 


(129) 


h  is  the  time  increment.  The  matrix  T  in  (128)  depends  on  the  model  used  to  represent 
the  discrete-time  nature  of  the  process  noise  v.  Two  examples  are  given  below.  The 
first  one 


'h2/ 2  0  ‘ 

0  h2/  2 

h  0 

0  h 


(130) 


9Since  the  acceleration  may  change  unforeseeably,  it  is  often  modeled  as  a  random  variable,  and  so  will  be  as 
such. 
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reprensents  to  the  pulse  model,  while  the  following  one 

3/p 


2\/3  2 


is  used  by  the  Brownian  motion  modelling.  Note  that  the  latter  requires  four  random 
variables  instead  of  two.  If  the  process  noises  are  assumed  to  have  the  same  standard 
deviation  <5„,  the  pulse  model  results  in  the  following  process  noise  covariance  matrix 

Q  =  <^ITr  (132 

r/r4  h 3  i 


while  the  covanance  matrix  for  the  brownian  motion  is  given  by 

q  =  <^rrr 

r/i3  h 2  i 


4.1  Sensor-level  tracker 

The  contact  fusion  problem  (at  the  sensor  level)  is  first  considered.  This  corresponds  to 
the  case  of  actually  independent  sources,  since  the  measurement  and  the  estimation 
noise  at  the  sensor  level  are  not  correlated.  The  target’s  position  (in  both  directions)  is 
the  only  measured  variable.  This  can  be  represented  by  the  following  observation 
equation 

1  (136) 

where  k  +  1  is  the  observation  time,  i  is  the  sensor  number  (=  1,2)  and  Ht  is  the 
observation  matrix  that  is  given,  for  both  sensors,  by 
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4.2  Central  tracker 

The  central  tracker  receives  and  fuses  the  tracks  from  the  two  sensor-level  trackers, 
which,  for  simplicity,  are  assumed  time  aligned.  Since  it  deals  with  correlated  sources, 
the  track-level  fusion  problem  is  more  challenging  than  the  contact-level  one.  Different 
methods  are  compared,  and  in  order  to  lighten  the  graphics,  each  method  is  separately 
plotted  versus  the  centralized  contact-level  fusion  approach.  Due  to  its  proven 
optimality,  the  latter  is  taken  as  a  reference,  in  the  performance  evaluation. 
Nevertheless,  the  performance  is  not  the  unique  comparison  criterion.  The  consistency 
is  another  important  property,  which  helps  in  choosing  the  appropriate  approach  for  a 
given  situation. 


4.3  Results 

To  compare  the  different  algorithms,  the  traces  of  the  actual  and  the  estimated  error 
covariance  matrix  of  the  central  tracker  are  plotted.  All  the  plotted  traces  are 
normalized  with  respect  to  the  trace  of  the  estimated  error  covariance  matrix  yielded  by 
the  centralized  contact-level  fusion.  The  results  presented  are  obtain  via  200 
Monte-Carlo  runs.  The  used  covariance  matrix  corresponds  to  the  pulse  model,  with 
Sv  —  12  and  h  =  .1.  The  sensor  noise  standard  deviations  are  given,  respectively,  by 
SVx  =  5  and  <5^  =  4  for  the  first  sensor,  and  SVx  =  6  and  SVy  —  3,  for  the  second  one. 
Note  that  the  sensors  are  not  assumed  identical,  and  the  positions  in  each  direction  (x  or 
y)  are  measured  with  a  different  accuracy.  The  over-sampling  rate  oc  has  been  fixed  to  5. 

Furthermore,  to  obtain  a  comparison  means  between  the  presented  methods,  two 
parameters  are  defined  (see  Table  1).  The  first  one  gc  corresponds,  for  each  considered 
method,  to  the  ratio  of  the  trace  of  the  estimated  covariance  matrix  to  the  trace  of  the 
actual  one.  This  gives  a  direct  measure  of  the  consistency  of  the  fusion  algorithms. 

Note  that  a  method  is  inconsistent,  if  gc  <  1.  The  second  parameter  gp,  which  is  >  1, 
deals  with  the  performance.  It  is  defined  by  the  ratio  of  the  trace  of  the  actual 
covariance  matrix  (yielded  by  each  method)  to  the  actual  covariance  matrix  yielded  by 
the  centralized  contact  fusion.  Note  that  the  more  gp  is  close  to  I,  the  more  the 
corresponding  method  is  performant. 


4.3.1  Best  track 

The  best  track  approach  consists  in  choosing,  between  the  two  tracks,  the  one 
that  yields  the  highest  performance,  according  to  some  criterion.  But  since  the 
information  contained  in  the  other  one  is  dropped,  this  approach  results,  as 
shown  in  Figure  4,  in  a  loose  of  performance  (gp  =  1.32).  The  best  track 
method  has  however  the  advantage  of  always  leading  to  a  consistent  estimate 
(gc  =  1.02).  The  consistency  is  guaranteed  because  the  central  track  is  always 
equal  to  one  of  the  two  sensor-level  tracks,  which  are  both  consistent. 
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4.3.2  Simple  fusion 

The  simple  fusion  assumes  the  independence  between  the  sensor-level  tracks, 
and  between  each  of  the  sensor-level  tracks  and  the  central  track.  It  therefore 
uses  a  standard  Kalman  filter  to  fuse  them,  which  obviously  leads  to 
inconsistency.  This  result  is  clearly  shown  in  Figure  5,  where  the  fusion 
algorithm  underestimates  the  actual  error  covariance  matrix  ( gc  —  0.35). 

4.3.3  Covariance  intersection 

As  shown  in  Figure  6,  the  covariance  intersection  allows  avoiding  the 
inconsistency  of  the  simple  fusion.  The  actual  covariance  matrix  is  indeed 
smaller  than  the  assumed  one  ( gc  =  1.12).  This  consistency  is  however 
obtained  at  the  expense  of  a  significant  loose  of  performance  {gp  =  1.20). 

4.3.4  Largest  ellipsoid 

The  results  given  in  Figures  7  &  8  are  conclusive,  since,  while  the  estimate  is 
still  consistent  ( gc  =  1.10),  the  assumed  covariance,  is  much  closer  the 
centralized  contact-level  fusion  one,  than  that  obtained  by  the  covariance 
intersection.  Indeed,  the  actual  error  is  only  10%  larger  than  the  one  obtained 
with  the  centralized  contact-level  fusion,  while  it  is  20%  in  the  case  of  the 
covariance  intersection.  The  performance  ratio  is  given  by  gp  =  1.10. 

Even  if  they  both  result  in  a  loose  of  performance,  both  of  the  covariance 
intersection  and  the  largest  ellipsoid  have  the  advantage  of  being  independent 
of  the  network  fusion  architecture.  This  makes  them  more  suitable  in 
decentralized  fusion  problems,  which  deal  with  arbitrary  topologies.  This  is 
not  the  case  of  the  three  remaining  methods,  which  are  less  general. 
Nevertheless,  when  they  can  be  implemented,  these  methods  guarantee  better 
performance. 

4.3.5  Weighted  covariance 

In  the  case  of  Figure  9,  the  estimate  yielded  by  the  weighted  covariance  is  not 
consistent,  since  the  filter  underestimates  the  actual  error  ( gc  =  0.88).  This 
can  be  attributed  to  that  the  obtained  estimated  cross  covariance  is  smaller 
than  the  actual  one.  The  increase  resulting  from  its  use  in  the  Kalman  filter  is 
therefore  not  sufficient  to  ensure  consistency. 

4.3.6  Tracklet  fusion  &  information  filter 

From  either  the  consistency  or  performance  viewpoint,  the  tracklet  fusion 
(Figure  10)  and  the  information  filter  (Figure  1 1),  represent  the  most 
interesting  solutions  (see  Table  1).  The  tracklet  fusion  presents  however  no 
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Time[s] 


Figure  6:  Covariance  intersection  fusion  (Q)  vs.  Contact  fusion  (□) 
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Figure  8:  Largest  ellipsoid  fusion  (A)  i/s  Covariance  Intersection  (O)  and  Contact  fusion  (□) 
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Figure  9:  Weighted  covariance  fusion  (O)  vs.  Contact  fusion  (□) 
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real  advantage  over  the  information  filter.  They  both  have  the  same 
computation/communication  requirements,  while  the  information  filter  is 

•  More  accurate  :  i.e.,  very  close  to  the  centralized  contact-level  fusion. 

•  Easier  to  implement :  does  not  require  the  modification  of  the  existing 
local  trackers  for  its  implementation. 

•  Maintains  full  tracks  :  instead  of  tracklets.  Full  tracks  can  be  used  in  the 
other  fusion  operations,  as  the  track  association,  which  is  not  the  case  of 
the  tracklets. 


4.4  Comparison 

The  comparison  results  are  summarized  in  Table  1.  It  is  clear  that,  when  the  network 
topology  allows  for  its  implementation10,  the  information  filter  is  the  method  to  be 
considered,  since  it  guarantees  both  the  consistency  and  the  minimum  mean  square 
error  optimality.  When  the  information  filter  cannot  be  implemented,  neither  of  the  less 
efficient  weighted  covariance  and  tracklet  fusion  can.  These  methods  cannot  therefore 
be  of  any  help.  In  this  case,  the  only  remaining  alternatives  are  the  covariance 
intersection  and  the  largest  ellipsoid  approaches.  Since  the  latter  is  more  efficient,  it 
represents  a  good  alternative  that  does  not  suffer  from  the  applicability  limitation. 


l0That  is,  is  the  case  of  small  networks,  with  a  known  information  flow. 
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Figure  1 1:  Information  filter  fusion  (0)  v's.  Contact  fusion  (□) 
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Method 

Qp 

Qc 

Contact  fusion 

1.00 

1.01 

Best  track 

1.32 

1.02 

Simple  fusion 

1.25 

0.35 

Covariance  intersection 

1.20 

1.12 

Largest  ellipsoid 

1.10 

1.10 

Weighted  covariance 

1.01 

0.88 

Information  filter 

1.00 

1.02 

Tracklet  fusion 

1.01 

1.02 

Table  1:  Performance/Consistency  comparison  of  the  different  track  fusion  methods 
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5.  Conclusion 


Various  trade-offs  are  generally  required  for  the  selection  of  the  data  fusion 
architecture,  since  each  approach  has  benefits  and  disadvantages.  As  discussed  in  the 
previous  chapters,  this  design  choice  affects  the  quality  of  the  fused  product  and  the 
nature  of  the  algorithms  or  techniques  that  may  be  used.  Hence,  besides  its  high 
vulnerability,  due  to  its  centralized  nature,  contact-level  fusion  presents  the 
disadvantage  of  being  very  demanding  in  terms  of  communication  bandwidth  and 
central  computation  capacity.  This  is  why  the  track-level  fusion  may  represent  a  good 
alternative,  and  the  only  possible  solution,  if  the  sensor  contacts  are  not  available  at  all. 
Nevertheless,  the  correlation  between  the  sensor-level  tracks,  and  between  each 
sensor-level  track  and  the  central  track,  is  at  the  origin  of  the  inconsistency  problem. 
This  results  in  an  underestimation  of  the  actual  error  covariance  matrix,  if  a  standard 
Kalman  filter  is  used  for  the  track-level  fusion.  Different  approaches  are  presented  to 
handle  this  inconsistency,  and  result  all  in  an  increased  estimated  error  covariance 
matrix.  The  amount  of  this  increase,  and  the  way  it  is  computed,  differs,  however,  from 
one  method  to  another,  leading  to  a  different  performance  and  conditions  of 
applicability. 

Due  to  its  minimum  mean  square  error  optimality  and  its  consistency,  the  information 
filter  is  the  method  to  be  considered,  when  the  fusion  architecture  allows  for  its 
implementation.  This  filter  guarantees  the  consistency  by  avoiding  double  counting  of 
information  in  the  fusion  process.  The  information  filter  is  applicable  where  the  tracklet 
algorithm  is,  and  is  more  efficient.  The  weighted  covariance  is  not  optimal  in  the 
minimum  mean  square  error  sense,  but  only  in  the  maximum  likelihood  sense. 
Furthermore,  its  implementation  is  not  always  possible.  It  does  not  therefore  present 
any  advantage  over  the  two  previous  ones.  When  the  applicability  is  the  major  concern, 
the  covariance  intersection  offers  a  robust  alternative  to  the  simple  fusion. 

Nevertheless,  to  avoid  underestimating  the  actual  error  covariance  matrix,  this  method 
overestimates  it  too  much.  This  results  in  a  significant  loose  in  performance.  A  good 
alternative  to  the  covariance  intersection  is  given  by  the  largest  ellipsoid  method.  The 
latter  inherits  the  advantage  of  the  covariance  intersection,  that  is  the  large  applicability 
and  consistency,  and  avoids  its  drawback,  viz.,  the  lack  of  performance.  As  the 
covariance  intersection,  this  method  is  also  based  on  the  estimation  of  the  intersection 
region,  but  provides  a  tighter  estimate. 
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Annex  A 

Implementation  of  Kalman  filter 


The  Kalman  filter  is  usually  implemented  as  a  recursive  algorithm.  The  procedure  starts 
from  an  initial  estimate  of  the  state  variables,  and  recursively  predicts  and  adjusts  this 
estimate  with  each  new  measurement.  From  a  practical  standpoint,  this  recursiveness 
makes  the  Kalman  filter  very  suitable  for  the  on-computer  implementation.  No  storage 
of  the  previous  data  is  required,  which  allows  real-time  operating.  This  recursive  nature 
has  much  helped  in  making  the  filter  very  popular. 


A.1  Recursive  algorithm 


The  standard  form  of  the  recursive  discrete-time  Kalman  filter,  can  be  summarized  in 
the  following  steps. 


1.  Initialization  —  The  filter  is  supplied  with  initial  information,  including  the 
estimate  of  the  initial  state 


x0|0  =  E 


and  the  measurement  error  covariance 


P0\0  =  R 

Note  that  different  initializations  might  be  used. 

2.  Prediction  of  the  state  —  The  most  recent  available  a  posteriori  estimate  of  the 
state,  namely  xk\k,  is  injected  in  the  system  model  to  yield  the  new  a  priori 
estimate  &k+i\k  °f  the  state  at  the  time  instant  k  +  1. 

^fc+l|A:  Ffc T  Gkuk  (A.l) 


3.  Prediction  of  the  covariance  matrix  —  A  prediction  of  the  estimation  error 

covariance  matrix  is  performed,  at  the  time  instance  k  +  1.  Its  computation  is  based 
upon  the  most  recent  available  a  posteriori  value  Pk\k- 

Pk+i\k  =  FkPk\kFk  +  Qt 


4.  Kalman  Gain  matrix  —  The  obtained  so  far  (predicted)  values  are  used  to 
calculate  the  new  Kalman  gain  matrix. 

wk  =  Pk+nkHl+l{Hk+lPk+l\kHl+l  +  R)~l 

Note  that  this  gain  is  needed  only  for  the  dnect  form  implementation. 

5.  Update  of  the  Covariance  Matrix  —  which  gives,  in  both  direct  and  inverse 
forms,  a  confidence  measure  in  the  estimate. 
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•  Direct  form  :  The  Kalman  matrix  gain  Wk+i  serves  to  update  the  estimation  of 
the  covariance  matrix. 

■Pfc+i|fc+i  =  (7-  Wk+1Hk+i)Pk+i\k 


•  Inverse  form  :  The  update  is  performed  without  the  need  of  Wk+ 1- 
4+W  ~  ^fc+l|fc  +  Hk+lR  lHk+l 


6.  Update  of  the  state  estimate 

•  Direct  form  :  The  error1 1  that  reflects  the  discrepancy  between  the  predicted 

measurement  based  upon  the  a  priori  estimate  and  the  newly  available 

measurement  zk+\  is  determined  and  multiplied  by  the  gain  matrix  Wfc+i  to 
compute  the  a  posteriori  estimate  at  time  instant  k  +  1. 

*fc+l|fc+l  =  T  ^^k+l(zk+l  —  Hk+1xk+Mk) 

•  Inverse  form  :  the  residual  is  not  computed,  and  the  update  rule  uses  a 
weighted  sum  of  the  a  priori  estimate  and  the  new  measurement. 


^fc+i|fc+i  —  -f\+i|fc+i 


-^fc+ilfc^fc+tlfc  "t"  Hk+iR  zk+ 1 


7.  At  time  k  +  2,  the  cycle  starts  again  at  step  2.  This  cycle  will  go  on  at  the  sampling 
rate. 

Note  that  the  system  noise  v  is  not  used  in  the  state  prediction  equation  (A.l).  This  is 
due  to  the  fact  that  the  best  prediction  one  can  make  for  a  white  noise  is  its  mean,  which 
happens  to  be  equal  to  zero  here. 


A.2  Array  algorithm  (Kalman  filter) 

Even  though  the  above-mentioned  implementation  does  not  show  it  explicitly,  the 
Kalman  filter  can  be  expressed  as  a  recursive  algorithm,  which  propagates  some  Riccati 
equation,  whose  solution  is  the  covariance  matrix  Pfc+1|fc+1.  A  sufficient  condition  to 
the  convergence  of  this  recursion  is  given  by  the  positivity  of  the  matrix  P*;+i|fc+i.  In 
this  algorithm,  due,  among  others,  to  the  unknown  modeling/measurement  errors,  this 
positivity  cannot  always  be  guaranteed. 

An  interesting  solution  to  this  problem  is  given  by  the  so-called  square-root  array 
algorithm  [24, 25].  Instead  of  propagating  the  covariance  itself,  this  solution  propagates 
its  square-root  matrix.  Hence,  squaring  the  resulting  matrix  will  ensure  the  positivity  of 
the  covariance.  The  principle  of  the  algorithm  is  shown  below. 

1  'Often  called  the  measurement  innovation  or  the  residual. 
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A.2.1  Time  update  recursion 

The  error  covariance  prediction  equation  is  given  by 

Pk+i\k  —  FkPk\kPk  +  Q 

=  ^4‘if  Ql/2]  <3I/2]r 

=  QV2]  e0T  \F*H(k  qU2\ 


where  0  is  any  unitary  matrix,  chosen  such  that 


00J  =  I 


Ik  Ql/2]e=[x  0] 


This  means  that  ©  has  as  a  mam  role  the  triangulanzation  of  the  matrix 


FtP$  O'/*’ 


These  conditions  will  ensure  that 


xxT=[x  o][x  o]: 


«1/2]  e°T  [^n‘ii2  <31/2 

FkPk\kFk  +  Q 


which  will  provide  the  square-root  (matrix)  of  the  covariance  matrix,  that  is, 

y  _  pt/2 

—  ifc+llfc 

This  result  gives  the  following  recursion  for  updating  this  square  root,  for  the 
a  priori  covariance  matrix. 


*1#$ 2  <51/2]  e  =  [n'fu,,  o’ 


A.2.2  State  update  recursion 

The  equations,  for  the  calculation  of  the  Kalman  gain  and  the  update  of  the 
error  covariance  matrix,  are  given  below. 

Wfc+1  -  Pk+i\kHl^{Hk+lPk+l\kHl+l  +  R)-1 

-Pfc+i|fc+i  =  Pk+i\k  —  Wk+lHk+lPk+l\k 

-Pfc-rl|A:  Pk+l\kPk+l  T  P)  F^k-{-lPk-\-X\k 
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We  define  the  matrix 


\RW 


r  = 


o 


A+y 


pt/2 

-ffc+l|fc 


and  suppose  that  we  know  a  matrix  ©  such  that  0©T  =  I  and 


r©  = 


X 

Y 


O' 

z 


By  squaring,  we  will  obtain 

r©©TrT  =  rrT 


'XXT  XYr  - 

YXr  yyt  +  ZZT_ 

R  +  Hfc+iPfc+1|fcffJ+1  Hk+iPk+i\k 

Rk+l\kRk+l  Rk+l\k 

A  simple  identification  of  the  terms  will  yield 

X  =  (R  +  iffc+1Pfc+1]fcJ7j+1)1/2 

Y  =  Pk+l]kHZ+1  (R  +  Hk+lPk+llkH^+l)  ~T/2 

^  =  (A+i|fc  -  YYT)l/2 
_ pV2 

fc+l|fc+l 

With  these  variables,  the  Kalman  gain  can  be  rewritten  as 
Wk+l  =  YX-1 


R1/2 

0 


This  notation  allows  us  to  express  the  recursion  as 


D1/2 


©  = 


{R  +  Hk+1Pk+1]kH^+1)1/2 
Pk+i\kHl+l  (R  +  Hk+iPk+MkHl+l)  ~T/2 


X  0 


Wfc+iX"1 


p1/2 

fc+llfc+l 


0 

p1/2 

■*fc+llfc+l. 


which  provides  all  the  necessary  information  for  the  implementation  of  the 
Kalman  filter.  Note  that  only  the  square  root  of  the  covariance  matrix  is 
propagated. 
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A.3  Array  algorithm  (covariance  intersection) 

With  a  small  modification,  the  same  array  algorithm  can  be  used  to  implement  the 
covariance  intersection  filter.  The  details  of  this  modification  are  given  below. 

A.3.1  Time  update  recursion 

Identical  the  Kalman  filter  case. 


A.3.2  State  update  recursion 

The  state  update  equation  is  given  by 


^k+l\k+l  =  -Pfc+l|fc+l 


',-^fc+l|fc*fc+l]k  T  (1  ul)H-k+ 1-^  zk+ 1 


(A. 2) 


where  the  error  covariance  matrix  is  calculated  by 


3-1 
/c+lj/c-fl 


—  ^Pk+i\k  +  ~  UJ)-^fc+i-R  1Hk+ 1 


(A.3) 


Using  the  matnx  inversion  lemma  (Eq.  41,  p.  11),  this  covariance  can  be 
expressed  as 


/c-f- 1  |/c 


fc+l|*  ttT 

Hk+l 


jR  +  (1  —  Lj)Hk+1Pk+1\kH, 


T 


H, 


k-)~l ' 


Ld 


id  Ld 

Using  (A.3),  the  update  rule  (A.2)  can  be  rewritten  as 

£fc+i|fc+i  =  £fc+i|k  +  (1  -  u>)PkH]:+lR~~1(zk+l  -  HMxk+1[k) 

—  T  Wk+1(zk+l  iTfc+tife+i|fc) 

where  the  covariance  intersection  gain  (which  is  equivalent  to  the  Kalman 
gain)  is  given  by 

Wfc+i  =  (1  —  w)Pfc+1|fe+1iT^hl12  1 


(1-cu) 


w-ffe+l|fc  +  (1  UJ)^'k+l^‘  lHk+ 1 


—  (1  -  d)Pk+i\kHi 


fc+t 


ujR  +  (1  —  w)Hfc+iPfc+1|fciJ'j 


/c+l 


-1 


As  for  the  Kalman  filter,  we  define  the  matrix 


r  = 


(ujR)1/2 


H, 


/c+1 


(1  —  tu)Pfc+t|fe 

3  "1  1/2 

k+l\k'  1 


1/2' 


LO 


50 


UNCLASSIFIED 


TR  2001-224 


P518346.PDF  [Page:  67  of  75] 


UNCLASSIFIED 


and  suppose,  also  as  in  the  Kalman  filter  case,  that  a  matrix  0  exists  such  that 
0©r  =  I  and 


r©  = 


X 

Y 


0 

Z 


By  squaring,  we  will  obtain 

=  rrr 

\XXT  xyt 
yxt  yyt  +  ZZT 

tvR+  (1  —  w)JFffc+iPfc+1|fcH'J+1 


'1 


-Hk+iPi 


U) 


k+l+k+\\k 


'  1  —  CJ  * 


OJ 


Pk+l\k-^k+l 


fc+l|fc 
U 1 


and  by  identification. 


uR+  (1  —  u>)Hk+iPk+i\kHk+i 


1/2 


Y  = 

Z  = 


'l-uA 


U) 


Pk+i\kHk+\ 


R  +  Hk+lPk+l\kHk+\ 


-Tj  2 


Pk+i\k~YYT 

pi/2 

Jfc+i|fc+i 


1/2 


{uR)1/2  Hk+i 


The  gam  Wfc+i  can  be  rewritten  as 

Wk+i  =  Vw(l  -  u)YX -1 
This  gives  as  a  final  recursion 
1/21 


(1  -  w)Pfc+i|fc 


1  1/2 


U) 


©  = 


L-»/ai(l  -  w) 


wk+1x- 


pi/2 

■rfc+i|fc+l 
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Annex  B 

Bayesian  interpretation  of  Kalman  filter 


There  are  many  ways  to  interpret  the  Kalman  filter  method.  Kalman’s  original 
paper  [11]  posed  the  problem  in  terms  of  error  (trace)  minimization.  The  Bayesian 
interpretation  of  the  Kalman  filter  did  not  become  popular  until  the  early  1970s.  From 
the  Bayesian  viewpoint,  the  Kalman  filter  propagates  the  conditional  probability 
density  of  the  desired  state,  conditioned  on  the  knowledge  of  the  measurement  data. 
The  Kalman  filter  maintains  the  first  two  moments  of  the  state  distribution12. 


E 


E 


xk+ 1 
T 


xk+l\k+l 


( xk+l  ®fc+l|fc+l)(‘*:A:+l  •*'fc4-l|fc+l) 


=  Pl 


fe+llfe+1 


If  the  Gaussian  and  whiteness  conditions,  of  the  noises  w  and  v  are  satisfied,  the  state 
will  be  normally  distributed,  with  as  a  mean  the  a  posteriori  estimate  and  a  variance, 
the  estimation  covariance  matrix,  that  is 

fx(xk+l\zk+l)  —  -^"(■^fc+l|A:4-li  -Pfc+l|fc+l) 

The  a  priori  probability  is  given  by 

fx  —  ff{xk+l\k>  Pk+l\k) 

~  2  ixk  ~  ^fc+llfc)  i.xk+l  ~  *^fc+l]fc) 

The  statistics  of  the  available  data,  i.e.  the  measurement,  can  be  expressed  as 


1 


(2ttW2I  A.  , 


exp 


f  z\x  N k+lX k-hl  i  E') 
1 

=  - - - rpj  exp 

{2n)ni2\R\/Z 


2  E%k+lxk+l')  P  (zk+l  EJ-k-tlxk+l') 


Given  these  two  probability  functions,  the  estimation  problem  consists  then  in 
maximizing  the  a  posteriori  estimation  probability,  whose  expression  is  given  by  the 
Bayes’s  rule 


fx\ 


Z 


fz\xfx 


fz 


Under  these  conditions,  the  a  posteriori  estimate  of  the  state  x  can  be  expressed  as 
xk+i\k+i  =  argmax 


'Sz\xSx 

=  arg  max 

fz\xfx 

l  fz  \ 

X 

UA  distribution  function  fx  of  a  random  variable  X  is  a  mathematical  relation  that  gives  for  each  number  x,  the 
probability  of  X  <  x. 


52 


UNCLASSIFIED 


TR  2001-224 


P518346.PDF  [Page:  69  of  75] 


UNCLASSIFIED 


since  fz  is  independent  of  x.  The  same  estimate  could  be  obtained  by  maximizing  the 
logarithm  of  the  a  posteriori  probability  function. 


£fc+i|fc+i  =  arg  max  In 
=  axgmax 


fz\xfx 
1  “ 


ln((27r)"|Pfc+1|Jfc|)  +  ln((27r)"|fl|) 
+  (-Efc-t-i  —  ®fc+i|fc)  —  *fc+i|fe) 

"h  (^fc+l  R  fek+1  ^ k+l'E k+l') 


Computing  the  negative  gradient  and  setting  it  equal  to  zero  yields 

°  =  _^ln(/zl x/x) 

x~xk-\-l\k+l 

—  -Pjt+ijfc (®fc+i|fc+i  —  ^fc+i|fc)  ~  Hk+iR  l(zk+\  —  T7fc+i*fc+i|fc+i) 

("^fc+llfc+l  —  ^fc+l|fc)  —  (zk+ 1  —  Hk+l&k+l\k) 


n+i|fc  +  HT+lR-'Hk+l 
This  gives 


®fc+i|fc+i  =  ®fc+i|fc  + 


-Pfc4-l|fc  Hk+\R  Hk+l  Hk+1R  (zfc+l  Hk+l&k+l\k) 


=  &k+i\k  +  Wk+i{zk+i  -  Hk+iXk+i\k) 


which  is  identical  to  the  equation  (50,  p.  12),  obtained  within  the  trace  minimization 
framework. 
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